https://en.yna.co.kr/view/AEN20240306003700320 Go to Contents Go to Navigation SEARCH History English * hangugeo * Zhong Wen * Ri Ben Yu * `rby * Espanol * Francais * Facebook * Twitter * RSS Feed News All Headlines National Politics Diplomacy Defense National North Korea Economy Economy Finance Health Latest News On the Record M&As Corporate Newsroom Earnings Startups Focus/Feature Stocks Culture Entertainment Movies K-pop Arts/Culture Sports Images K-wave General North Korea Graphics Videos Korea Now Top News Most Viewed Korean Newspaper Headlines Today in Korean History Yonhap News Summary Editorials from Korean Dailies Special * Interviews * Features * Topics * Yonhap Korea Stories Information * Korea in Brief * Useful Links * Festival Calendar * Weather * Advertise with Yonhap News Agency Tools * RSS * Mobile Service * Sitemap About Yonhap * About Us * About Yonhap News * Mission * CEO's Message * History * Subsidiaries * Domestic Network * Global Network * Products/Services * Headquarters * Subscription * Copyright SEARCH [ ] Text Delete SEARCH #KAIST #LLM accelerator #AI chip Yonhap News Agency KAIST develops next-generation ultra-low power LLM accelerator Today's date Today's weather Seoul Full Forecast gureumjogeum Partly Sunny 17.3 16deg / 28deg Precip 0mm Wind W 3.5m/s Humidity 45% CAI Moderate 80 PM10 Good DSS Very Bad PM2.5 Bad O3 Moderate close CAI Comprehensive Air-quality Index PM10 Particulate Matter Less than 10micrometer PM2.5 Particulate Matter Less than 2.5micrometer O3 Ozone Latest News Pause more Close * All News * National + Politics + Diplomacy + Defense + National * North Korea * Economy/Finance + Economy + Finance + Health * BIZ + Latest News + On the Record + M&As + Corporate Newsroom + Earnings + Startups + Focus/Feature + Stocks * Culture/K-pop + Entertainment + Movies + K-pop + Arts/Culture * Sports * Images + K-wave + General + North Korea + Graphics * Videos Facebook X More Pinterest Linked in Tumblr Reddit Facebook Messenger Copy URL URL is copied. OK KAIST develops next-generation ultra-low power LLM accelerator Kim Na-young, gimnayeong Kim Na-young All News 12:00 March 06, 2024 SHARE Facebook X Pinterest Linked in Tumblr Reddit Facebook Messenger Copy URL URL is copied. LIKE SAVE PRINT FONT SIZE * (*) ABCDEFG * ( ) ABCDEFG * ( ) ABCDEFG * ( ) ABCDEFG * ( ) ABCDEFG By Kim Na-young SEOUL, March 6 (Yonhap) -- A research team at the Korea Advanced Institute of Science and Technology (KAIST) has developed the world's first artificial intelligence (AI) semiconductor capable of processing a large language model (LLM) with ultra-low power consumption, the science ministry said Wednesday. The team, led by Professor Yoo Hoi-jun at the KAIST PIM Semiconductor Research Center, developed a "Complementary-Transformer" AI chip, which processes GPT-2 with an ultra-low power consumption of 400 milliwatts and a high speed of 0.4 seconds, according to the Ministry of Science and ICT. The 4.5-mm-square chip, developed using Korean tech giant Samsung Electronics Co.'s 28 nanometer process, has 625 times less power consumption compared with global AI chip giant Nvidia's A-100 GPU, which requires 250 watts of power to process LLMs, the ministry explained. The chip is also 41 times smaller in area than the Nvidia model, enabling it to be used on devices like mobile phones. The ministry said the utilization of neuromorphic computing technology, specifically spiking neural networks (SNNs), is essential to the achievement. Previously, the technology was less accurate than deep neural networks (DNNs) and mainly capable of simple image classifications, but the research team succeeded in improving the accuracy of the technology to match that of DNNs to apply it to LLMs. The team said its new AI chip optimizes computational energy consumption while maintaining accuracy by using unique neural network architecture that fuses DNNs and SNNs, and effectively compresses the large parameters of LLMs. A photo describing an artificial intelligence chip which processes a large language model with neuromorphic computing technology provided by the Ministry of Science and ICT on March 6, 2024 (PHOTO NOT FOR SALE) (Yonhap) A photo describing an artificial intelligence chip which processes a large language model with neuromorphic computing technology provided by the Ministry of Science and ICT on March 6, 2024 (PHOTO NOT FOR SALE) (Yonhap) nyway@yna.co.kr (END) Related Articles * Meta CEO discusses AI, XR with S. Korean startups * (2nd LD) Facebook founder Zuckerberg meets key Samsung, LG officials * Samsung Electronics develops 36GB HBM3E with 12 layers * SK Telecom, global telcos to form language-model joint venture [INS::INS] [INS::INS] Keywords #KAIST #LLM accelerator #AI chip [INS::INS] Issue Keywords Most Liked * Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' * Steven Harrington's 1st museum exhibition in Seoul: Stay calm through 'Stay Mello' Steven Harrington's 1st museum exhibition in Seoul: Stay calm through 'Stay Mello' * BTS' V set to release English song 'FRI(END)S' next week BTS' V set to release English song 'FRI(END)S' next week * TvN's romantic series 'Queen of Tears' dives into spectrum of emotions TvN's romantic series 'Queen of Tears' dives into spectrum of emotions * (LEAD) U.S. nuclear envoy underlines need for 'interim steps ' toward ultimate N. Korea denuclearization (LEAD) U.S. nuclear envoy underlines need for 'interim steps ' toward ultimate N. Korea denuclearization Most Saved * Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' * Steven Harrington's 1st museum exhibition in Seoul: Stay calm through 'Stay Mello' Steven Harrington's 1st museum exhibition in Seoul: Stay calm through 'Stay Mello' * TvN's romantic series 'Queen of Tears' dives into spectrum of emotions TvN's romantic series 'Queen of Tears' dives into spectrum of emotions * (2nd LD) Gov't takes steps to suspend licenses of some 7,000 defiant trainee doctors (2nd LD) Gov't takes steps to suspend licenses of some 7,000 defiant trainee doctors * Number of marriages in S. Korea down 40 pct over past 10 yrs, driving down fertility rate Number of marriages in S. Korea down 40 pct over past 10 yrs, driving down fertility rate Most Viewed All Categories * KAIST develops next-generation ultra-low power LLM accelerator KAIST develops next-generation ultra-low power LLM accelerator * Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' Song Joong-ki delves into themes of guilt in 'My Name is Loh Kiwan' * (LEAD) Nurses allowed to perform CPR on emergency patients as trainee doctors' walkout continues (LEAD) Nurses allowed to perform CPR on emergency patients as trainee doctors' walkout continues * (LEAD) N.K. leader calls for intensifying war drills (LEAD) N.K. leader calls for intensifying war drills * (2nd LD) N.K. leader calls for intensifying war drills (2nd LD) N.K. leader calls for intensifying war drills Most Viewed More Most Viewed Photos * N.K. leader inspects military training base N.K. leader inspects military training base * Agricultural workers' sports contest in N. Korea Agricultural workers' sports contest in N. Korea * N.K. leader inspects military training base N.K. leader inspects military training base * N.K. leader inspects military training base N.K. leader inspects military training base prev KAIST develops next-generation ultra-low power LLM accelerator KAIST develops next-generation ultra-low power LLM accelerator Next KAIST develops next-generation ultra-low power LLM accelerator KAIST develops next-generation ultra-low power LLM accelerator Main Article Right Now Nurses allowed to perform CPR on emergency patients as trainee doctors' walkout continues Nurses allowed to perform CPR on emergency patients as trainee doctors' walkout continues Foreign ministry shakes up bureau handling N.K. nuclear issue amid prolonged impasse in talks Foreign ministry shakes up bureau handling N.K. nuclear issue amid prolonged impasse in talks * Crypto entrepreneur Kwon should be extradited to S. Korea: Montenegro court * Air Force stages live-fire drills against N.K. cruise missile, artillery threats * N. Korea set to take part in tourism exhibition in Moscow to lure Russian tourists * No plan for now to restart sale of HMM: oceans minister HOME All News News All News National North Korea Economy/Finance Biz Culture/K-pop Sports Images Videos Top News Most Viewed Korean Newspaper Headlines Today in Korean History Yonhap News Summary Editorials from Korean Dailies Special Interviews Features Topics Yonhap Korea Stories Information Korea in Brief Useful Links Festival Calendar Weather Advertise with Yonhap News Agency Tools RSS Mobile Service About Yonhap About Us Contact Us Subscription Copyright Copyright (c) Yonhap News Agency. All Rights Reserved. LANGUAGE * hangugeo * Zhong Wen * Ri Ben Yu * `rby * Espanol * Francais Privacy Policy * Facebook * Twitter * RSS Feed * Sitemap HOME TOP Send Feedback Close How can we improve? Enter your feedback here. To help protect your privacy, don't include personal information, like your name or address. [ ] [SUBMIT] Thanks for your feedback! CLOSE