https://www.wsj.com/articles/meta-unveils-new-ai-supercomputer-11643043601 Skip to Main ContentSkip to Search Dow Jones, a News Corp companyAbout WSJ * News Corp is a global, diversified media and information services company focused on creating and distributing authoritative and engaging content and other products and services. * Dow Jones + Barron's + BigCharts + Dow Jones Businesses + Dow Jones Newswires + Factiva + Financial News + Mansion Global + MarketWatch + Newsmart + NewsPlus + Risk & Compliance + WSJ Live + WSJ Pro + WSJ Video + WSJ.com * News Corp + Avail + Business Spectator + HarperCollins Publishers + Housing + Makaan + New York Post + REA + realtor.com + Storyful + The Australian + The Sun + The Times * The Wall Street Journal SubscribeSign In English Edition * English * Zhong Wen (Chinese) * Ri Ben Yu (Japanese) Print Edition Video Podcasts Latest Headlines SubscribeSign In * Home * World Regions + Africa + Asia + Canada + China + Europe + Latin America + Middle East Sections + Economy More + World Video * U.S. Sections + Economy + Law + Politics More + WSJ Noted. + U.S. Video + What's News Podcast * Politics Sections + Capital Journal More + Politics Video Columns + Gerald Seib + Washington Wire * Economy WSJ Pro + Bankruptcy + Central Banking + Private Equity + Strategic Intelligence + Venture Capital More + Economic Forecasting Survey + Economy Video Sections + Capital Account * Business Sections + Management + The Future of Everything + Obituaries + Tech/WSJ.D Industries + Aerospace & Defense + Autos & Transportation + Commercial Real Estate + Consumer Products + Energy + Entrepreneurship + Financial Services + Food & Services + Health Care + Hospitality + Law + Manufacturing + Media & Marketing + Natural Resources + Retail C-Suite + CFO Journal + CIO Journal + CMO Today + Logistics Report + Risk & Compliance Columns + Heard on the Street WSJ Pro + Artificial Intelligence + Bankruptcy + Central Banking + Cybersecurity + Private Equity + Strategic Intelligence + Sustainable Business + Venture Capital More + Business Video + Journal Report + Business Podcast + Space & Science * Tech Sections + CIO Journal + The Future of Everything + Personal Tech Columns + Christopher Mims + Joanna Stern + Julie Jargon + Nicole Nguyen More + Tech Video + Tech Podcast * Markets Sections + Bonds + Commercial Real Estate + Commodities & Futures + Stocks + Personal Finance + WSJ Money + Streetwise + Intelligent Investor Columns + Heard on the Street + Greg Ip + Jason Zweig + Laura Saunders + James Mackintosh Market Data + Market Data Home + U.S. Stocks + Currencies + Companies + Commodities + Bonds & Rates + Mutual Funds & ETFs More + CFO Journal + Markets Video + Your Money Briefing Podcast + Secrets of Wealthy Women Podcast Search Quotes and Companies * Opinion Columnists + Gerard Baker + Sadanand Dhume + James Freeman + William A. Galston + Daniel Henninger + Holman W. Jenkins + Andy Kessler + William McGurn + Walter Russell Mead + Peggy Noonan + Mary Anastasia O'Grady + Jason Riley + Joseph Sternberg + Kimberley A. Strassel More + Editorials + Commentary + Future View + Letters to the Editor + The Weekend Interview + Potomac Watch Podcast + Foreign Edition Podcast + Opinion Video + Notable & Quotable * Books & Arts Reviews + Film + Television + Theater + Masterpiece Series + Music + Dance + Opera + Exhibition + Cultural Commentary Sections + Arts + Books More + WSJ Puzzles + Life Video + Arts Video * Real Estate Sections + Commercial Real Estate More + Real Estate Video * Life & Work Sections + Cars + Careers + Entertainment + Food & Drink + Home & Design + Ideas + Personal Finance + Recipes + Style & Fashion + Travel + Wellness Columns + Your Health + Work & Life + The Middle Seat + Bonds + At Work + Turning Points + Off Brand + On Trend + On Wine More + WSJ Puzzles + Space & Science * WSJ. Magazine Sections + Fashion + Art & Design + Travel + Food + Culture * Sports Columns + Jason Gay Sections + MLB + NBA + NFL + Golf + Tennis + Soccer Search * Home * World Regions + Africa + Asia + Canada + China + Europe + Latin America + Middle East Sections + Economy More + World Video * U.S. Sections + Economy + Law + Politics More + WSJ Noted. + U.S. Video + What's News Podcast * Politics Sections + Capital Journal More + Politics Video Columns + Gerald Seib + Washington Wire * Economy WSJ Pro + Bankruptcy + Central Banking + Private Equity + Strategic Intelligence + Venture Capital More + Economic Forecasting Survey + Economy Video Sections + Capital Account * Business Sections + Management + The Future of Everything + Obituaries + Tech/WSJ.D Industries + Aerospace & Defense + Autos & Transportation + Commercial Real Estate + Consumer Products + Energy + Entrepreneurship + Financial Services + Food & Services + Health Care + Hospitality + Law + Manufacturing + Media & Marketing + Natural Resources + Retail C-Suite + CFO Journal + CIO Journal + CMO Today + Logistics Report + Risk & Compliance Columns + Heard on the Street WSJ Pro + Artificial Intelligence + Bankruptcy + Central Banking + Cybersecurity + Private Equity + Strategic Intelligence + Sustainable Business + Venture Capital More + Business Video + Journal Report + Business Podcast + Space & Science * Tech Sections + CIO Journal + The Future of Everything + Personal Tech Columns + Christopher Mims + Joanna Stern + Julie Jargon + Nicole Nguyen More + Tech Video + Tech Podcast * Markets Sections + Bonds + Commercial Real Estate + Commodities & Futures + Stocks + Personal Finance + WSJ Money + Streetwise + Intelligent Investor Columns + Heard on the Street + Greg Ip + Jason Zweig + Laura Saunders + James Mackintosh Market Data + Market Data Home + U.S. Stocks + Currencies + Companies + Commodities + Bonds & Rates + Mutual Funds & ETFs More + CFO Journal + Markets Video + Your Money Briefing Podcast + Secrets of Wealthy Women Podcast Search Quotes and Companies * Opinion Columnists + Gerard Baker + Sadanand Dhume + James Freeman + William A. Galston + Daniel Henninger + Holman W. Jenkins + Andy Kessler + William McGurn + Walter Russell Mead + Peggy Noonan + Mary Anastasia O'Grady + Jason Riley + Joseph Sternberg + Kimberley A. Strassel More + Editorials + Commentary + Future View + Letters to the Editor + The Weekend Interview + Potomac Watch Podcast + Foreign Edition Podcast + Opinion Video + Notable & Quotable * Books & Arts Reviews + Film + Television + Theater + Masterpiece Series + Music + Dance + Opera + Exhibition + Cultural Commentary Sections + Arts + Books More + WSJ Puzzles + Life Video + Arts Video * Real Estate Sections + Commercial Real Estate More + Real Estate Video * Life & Work Sections + Cars + Careers + Entertainment + Food & Drink + Home & Design + Ideas + Personal Finance + Recipes + Style & Fashion + Travel + Wellness Columns + Your Health + Work & Life + The Middle Seat + Bonds + At Work + Turning Points + Off Brand + On Trend + On Wine More + WSJ Puzzles + Space & Science * WSJ. Magazine Sections + Fashion + Art & Design + Travel + Food + Culture * Sports Columns + Jason Gay Sections + MLB + NBA + NFL + Golf + Tennis + Soccer Search [ ]Search https://www.wsj.com/articles/ meta-unveils-new-ai-supercomputer-11643043601 Share * Facebook * Twitter * LinkedIn * Copy Link * CIO Journal Meta Unveils New AI Supercomputer When the AI Research SuperCluster is fully built it will be the fastest AI supercomputer in the world, the Facebook parent says [im-472356] Meta's new AI supercomputer, the AI Research SuperCluster, was the result of nearly two years of work involving several hundred people. Photo: Meta Platforms Inc. By Suman Bhattacharyya Close Suman Bhattacharyya * Biography * @newsient * Suman.Bhattacharyya@wsj.com Jan. 24, 2022 12:00 pm ET Meta Platforms Inc. said Monday that its research team built a new artificial intelligence supercomputer that the company maintains will soon be the fastest in the world. The supercomputer, the AI Research SuperCluster, was the result of nearly two years of work, often conducted remotely during the height of the pandemic, and led by the Facebook parent's AI and infrastructure teams. Several hundred people, including researchers from partners Nvidia Inc., Penguin Computing Inc. and Pure Storage Inc., were involved in the project, the company said. --------------------------------------------------------------------- Newsletter Sign-up WSJ | CIO Journal The Morning Download delivers daily insights and news on business technology from the CIO Journal team. PREVIEW SUBSCRIBE --------------------------------------------------------------------- Meta, which announced the news in a blog post Monday, said its research team currently is using the supercomputer to train AI models in natural-language processing and computer vision for research. The aim is to boost capabilities to one day train models with more than a trillion parameters on data sets as large as an exabyte, which is roughly equivalent to 36,000 years of high-quality video. "The experiences we're building for the metaverse require enormous compute power...and RSC will enable new AI models that can learn from trillions of examples, understand hundreds of languages, and more," Meta CEO Mark Zuckerberg said in a statement provided to The Wall Street Journal. Meta's AI supercomputer houses 6,080 Nvidia graphics-processing units, putting it fifth among the fastest supercomputers in the world, according to Meta. By mid-summer, when the AI Research SuperCluster is fully built, it will house some 16,000 GPUs, becoming the fastest AI supercomputer in the world, Meta said. The company declined to comment on the location of the facility or the cost. Artificial intelligence typically requires computers to perform a large number of low-precision calculations at the same time. GPUs are well suited for the task as they have thousands of processing cores that can work simultaneously. "For us, it's an order of magnitude larger compute that's available to our researchers to train a single model with a lot more compute than anybody else in the world has access to," Jerome Pesenti, vice president of AI at Meta, said in an interview. "We believe that this will really unlock an AI that just understands the world around you much, much better." Regular supercomputers are optimized for high-precision activity, whereas AI supercomputers operate on much lower levels of precision, gaining speed without affecting the end results, said Shubho Sengupta, a software engineer at Meta who was one of the leads on the supercomputer initiative. High-performance computing infrastructure, such as a supercomputer, is necessary to make sense of the volumes of data that Facebook needs, said Bill Gropp, director of the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign. "In Facebook's case, I suspect what they're looking at is the treasure trove that they have of the data that they get from their users, and that's a huge data set, too big for most of the artificial intelligence systems that researchers typically use," Dr. Gropp said. Meta's supercomputer is being used for research purposes, said Mr. Pesenti, with products not likely arising from it for years. The objective is to ingest troves of data to build AI models that can think like a human brain, with multiple inputs--such as voice and visual recognition--and can deliver contextual understanding of situations. More from CIO Journal * New York Health Insurer Taps New CIO January 20, 2022 * Discount Tire's Tech Revamp Positions It for Shift to EVs, CIO Says January 20, 2022 * Microsoft's Activision Deal May Bring 'Metaverse' to Enterprise Tech January 18, 2022 "You want to have an artificial intelligence that's a lot more context aware, that understands all the subtleties and a level of granularity that we can't match today," said Mr. Pesenti. Eventually the supercomputer will help Meta's researchers build AI models that can work across hundreds of languages, analyze text, images and video together and develop augmented reality tools, the company said. The technology also will help Meta more easily identify harmful content and will aim to help Meta researchers develop artificial-intelligence models that think like the human brain and support rich, multidimensional experiences in the metaverse. "In the metaverse, it's one hundred percent of the time, a 3-D multi-sensorial experience, and you need to create artificial-intelligence agents in that environment that are relevant to you," said Mr. Pesenti. Related Video Real-estate transactions in the metaverse are reaching record highs. We spoke with companies investing in digital real estate to understand the economic model, and why investors are spending millions on virtual property. Photo: Republic Realm Write to Suman Bhattacharyya at Suman.Bhattacharyya@wsj.com Copyright (c)2022 Dow Jones & Company, Inc. All Rights Reserved. 87990cbe856818d5eddac44c7b1cdeb8 CONTENT FROM OUR SPONSOR Deloitte * At Capital One, a New Era in Customer Experience Capital One has been investing heavily to redefine banking environments and provide differentiated experiences for customers. Lia Dean, the company's president of retail bank and premium card products, discusses its approach to innovation. * In a Divestiture, Proactively Address Comingled Data Divestitures can play an important role in helping enterprises redefine and reshape their business models, but risks may abound when there's comingled data involved. Increasingly, companies are identifying and protecting this data early--before it raises red flags for regulators or other stakeholders. * Engage Consumers With Dynamic Content As AI and other technologies provide more advanced targeting capabilities, organizations are beginning to develop content factories to churn out personalized, contextually relevant experiences to consumers. More CIO Insights from Deloitte The Wall Street Journal news department was not involved in the creation of this content. Sponsored Offers * Wayfair: Extra 15% off + free shipping at Wayfair * Target: Up to 60% off - Target Promo Code * Macy's: Macy's coupon - Sign up to get 25% off next order * Kohl's: 30% off for Rewards members * Saks Fifth Avenue: $20 off sitewide + free shipping - Saks Fifth Avenue coupon * PrettyLittleThing: Sign up for emails and get 20% off PrettyLittleThing discount code + $1 shipping CONTENT FROM OUR SPONSOR Deloitte * At Capital One, a New Era in Customer Experience Capital One has been investing heavily to redefine banking environments and provide differentiated experiences for customers. Lia Dean, the company's president of retail bank and premium card products, discusses its approach to innovation. * In a Divestiture, Proactively Address Comingled Data Divestitures can play an important role in helping enterprises redefine and reshape their business models, but risks may abound when there's comingled data involved. Increasingly, companies are identifying and protecting this data early--before it raises red flags for regulators or other stakeholders. * Engage Consumers With Dynamic Content As AI and other technologies provide more advanced targeting capabilities, organizations are beginning to develop content factories to churn out personalized, contextually relevant experiences to consumers. More CIO Insights from Deloitte The Wall Street Journal news department was not involved in the creation of this content. Most Popular News * Stocks Come Back to Finish Wild Day With Gains Stocks Come Back to Finish Wild Day With Gains * U.S. Food Supply Is Under Pressure, From Plants to Store Shelves U.S. Food Supply Is Under Pressure, From Plants to Store Shelves * Moms in Middle Age: Rarely Alone, Often Online and Increasingly Lonely Moms in Middle Age: Rarely Alone, Often Online and Increasingly Lonely * Ford Shuts Off Orders for New $20,000 Maverick Pickup Ford Shuts Off Orders for New $20,000 Maverick Pickup * Green M&M's Fashion Makeover Is Covid Comfy but Not Everyone Is Happy Green M&M's Fashion Makeover Is Covid Comfy but Not Everyone Is Happy Most Popular Opinion * 90% of Everything Is . . . Take a Guess Opinion: 90% of Everything Is . . . Take a Guess * The Alzheimer's Death Panel Opinion: The Alzheimer's Death Panel * Is Germany a Reliable American Ally? Nein Opinion: Is Germany a Reliable American Ally? Nein * Censuring Senator Sinema Opinion: Censuring Senator Sinema * Youngkin Nixes 'Equity' for 'Opportunity' Opinion: Youngkin Nixes 'Equity' for 'Opportunity' Most Popular Videos * [https://m.wsj.net/video/20220121/012122ukrainesatellite/ 012122ukrainesatellite_167x94.jpg] Satellite Images Show Russia's Military Buildup Near Ukraine * [https://m.wsj.net/video/20220121/012122fordgmevs/ 012122fordgmevs_167x94.jpg] Ford vs. GM: Old Rivals Battle for Share of the EV Truck Market * [https://images.wsj.net/im-472640?width=167&height=94] Fire Along California's Big Sur Shuts Part of Scenic Highway 1 * [https://m.wsj.net/video/20220121/011822princeandrewsplash/ 011822princeandrewsplash_167x94.jpg] Prince Andrew's Money: How Sexual Abuse Allegations Are Testing the Royals * [https://m.wsj.net/video/20220121/012421seib.midtermswalkup/ 012421seib.midtermswalkup_167x94.jpg] Retirements Are Latest Challenge Facing Democrats Ahead of Midterms Advertisement * The Wall Street Journal * English Edition + English + Zhong Wen (Chinese) + Ri Ben Yu (Japanese) * + Subscribe Now + Sign In * Back to Top << WSJ Membership * WSJ+ Membership Benefits * Subscription Options * Why Subscribe? * Corporate Subscriptions * Professor Journal * Student Journal * WSJ High School Program * Public Library Program * WSJ Live Customer Service * Customer Center * Contact Us Tools & Features * Emails & Alerts * Guides * Topics * My News * RSS Feeds * Video Center * Watchlist * Podcasts * Visual Stories Ads * Advertise * Commercial Real Estate Ads * Place a Classified Ad * Sell Your Business * Sell Your Home * Recruitment & Career Ads * Coupons More * About Us * Commercial Partnerships * Content Partnerships * Corrections * Jobs at WSJ * News Archive * Register for Free * Reprints & Licensing * Buy Issues * WSJ Shop * Facebook * Twitter * Instagram * YouTube * Podcasts * Snapchat * Google Play * App Store Dow Jones Products * Barron's * BigCharts * Dow Jones Newswires * Factiva * Financial News * Mansion Global * MarketWatch * Private Markets * Risk & Compliance * WSJ Pro * WSJ Video * WSJ Wine * Privacy Notice * Cookie Notice * Do Not Sell My Personal Information * Copyright Policy * Data Policy * Subscriber Agreement & Terms of Use * Your Ad Choices * Accessibility * Copyright (c)2022 Dow Jones & Company, Inc. All Rights Reserved. Copyright (c) 2022 Dow Jones & Company, Inc. All Rights Reserved