https://www.hpcwire.com/2021/08/27/esperanto-silicon-in-hand-champions-the-efficiency-of-its-1092-core-risc-v-chip/ Search the site [ ] Go Tabor Network: * [d] Datanami * [e] EnterpriseAI * [hpcwj_favi] HPCwire Japan * # HPC & AI Wall Street Toggle navigation [hpcwire_lo] Search the site [ ] Go Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them * Home * Technologies + Applications + Cloud + Developer Tools + Interconnects + Middleware + Networks + Processors + Quantum + Storage + Systems + Visualization * Sectors + Academia & Research + Entertainment + Financial Services + Government + Life Sciences + Manufacturing + Oil & Gas + Retail * COVID-19 * AI/ML/DL * Exascale * Specials + SC o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 o 2009 o 2008 + ISC o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 o 2009 o 2008 + People to Watch o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 + Readers' Choice Awards o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 + HPC + AI Wall Street o 2018 o 2009 o 2008 + Advanced Scale Forum * Resource Library * Podcast * Events + Events + Advanced Scale Forum + HPC + AI Wall Street * Job Bank * About + About HPCwire + Organizations and Affiliations + Customer Testimonials + HPCwire Editorial Submissions + Subscribe + HPCwire Custom Reprints + Contact Us * Our Authors * Solution Channels + AWS * Subscribe [esperanto-] Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip By Oliver Peckham August 27, 2021 Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single PCIe card. Now, Esperanto is back, silicon in-hand and taking aim at the competition with bold estimates of ET-SoC-1's energy efficiency. ET-SoC-1 First, a refresher: ET-SoC-1 can operate either as a standalone processor or as a PCIe-driven accelerator. At Hot Chips 33 this week, Esperanto Technologies founder and executive chairman Dave Ditzel called it "the world's highest-performance commercial RISC-V chip." "On one 7nm chip," he said, "we put 1,088 energy-efficient ET-Minion RISC-V processors, each with its own vector/tensor unit; four high-performance ET-Maxion RISC-V processors; over 160 million bytes of on-chip SRAM; and interfaces for external DRAM and flash memory." The chip is aimed at machine learning recommendation workloads, which Ditzel said were among the most important workloads for datacenters due to their increasing popularity coupled with their demanding performance memory requirements. Most of these datacenters, Ditzel explained, were running x86 servers with open PCIe slots, leaving Esperanto an opening to enter existing datacenters through a high-performing PCIe card. Performance maximization through energy efficiency Operating with existing datacenters meant adhering to a set of requirements. Perhaps most importantly, the PCIe slots have a limited power budget - around 75 to 120 watts. "Esperanto's challenge was how to put the highest recommendation performance onto a single PCIe-based accelerator card using no more than six of our chips and no more than 120 watts," Ditzel said. This left Esperanto at a fork in the road. "Some of the other solutions use one giant hot chip that uses up the entire power budget of the accelerator card," Ditzel said. "Single-chip solutions often push for the highest operating frequencies, but this comes with very high power and it's not very energy efficient. Esperanto realized that transistors - particularly 7nm FinFETs - are much more energy-efficient when operated at low voltages." Ditzel illustrated this point with a graph showing the energy efficiency of ET-SoC-1 (described in terms of inferences per second per watt) across different operating voltages. [esperanto-voltages]Image courtesy of Dave Ditzel/Esperanto Technologies. At the highest operating frequency (0.9 volts), Ditzel said, just one of their chips could use 275 watts - well beyond the power budget of a PCIe slot. At 0.67 volts, they could come in just under the power budget. But if, instead, they followed the peak of the energy efficiency graph, the entire chip would consume just 8.5 watts and the six chips would fit in a 120-watt budget with "room to spare." With six chips, the performance would be two and a half times better than the one-chip solution, and the energy efficiency twenty times better than the 275-watt scenario. Of course, they'd want to use up the entire power budget - and operating at about 0.4 volts, Ditzel said, one chip would take about 20 watts. Using six chips at that voltage yielded four times better performance than the one-chip solution. [esperanto-glacier-point-v2]An example of how three ET-SoC-1 chips could fit on each side of a Glacier Point v2 PCIe card. Image courtesy of Dave Ditzel/Esperanto Technologies. Squaring up to the competition Of course, Esperanto is facing down an increasingly crowded field of accelerators. So: after all this work on efficiency, how does ET-SoC-1 actually stack up? For that, Esperanto turned to the MLPerf deep learning recommendation model benchmarks for the Intel Xeon Platinum 8380H 8S (an example of a server chip) and two Nvidia GPUs, the A10 and the T4. With respect to the ET-SoC-1, Ditzel said that "all the performance [metrics] for Esperanto shown so far are projections based upon gate-level simulations of the entire chip and a large Synopsys ZeBu hardware emulation system." Using the Xeon chip as the baseline, Esperanto presented comparisons of the relative performance and relative performance per watt of the four processors. The T4 operated at 11 times the performance and 39 times the performance per watt of the Xeon chip; the A10, at 31 times and 52 times, respectively; the ET-SoC-1, 59 times and 123 times. [mlperf-benchmark-esperanto]Image courtesy of Dave Ditzel/Esperanto Technologies. Using the ResNet-50 inference benchmark, the processors showed similar results, with the ET-SoC-1 again arriving in first place with 15.4 times the performance and 25.7 times the performance per watt of the Xeon chip. Unsurprisingly, Esperanto is particularly interested in its projected performance-per-watt dominance. "Our position is that performance-per-watt is actually a better metric of performance, since everyone ought to be measured at similar power usage," Ditzel said. [et-soc-1-silicon]The ET-SoC-1 silicon. Image courtesy of Dave Ditzel /Esperanto Technologies. The future Esperanto has big ambitions: in his presentation, Ditzel talked about how, using open-source Glacier Point designs, a single large datacenter could contain millions of ET-SoC-1 chips. For now, though, the Mountain View-based company is still laying its foundation. "At the time of this recording, we've recently received silicon in our labs and are in the process of bringing up chip testing," Ditzel said, showing off the first 7nm ET-SoC-1 chip mounted in the package. To learn more, read our previous coverage of Esperanto Technologies here. Leading Solution Providers Altair AMD Ansys Arm Aspen Systems Atempo Atos AWS Bright Computing CoolIT Cornelis Networks DDN Dell DUG Fujitsu HPE Inspur Intel Lenovo Motivair NEC Oracle Pavilion QCT Silicon Mechanics Tintri TotalCAE * Off The Wire * Industry Headlines * August 27, 2021 * Carnegie Mellon, University of Washington to Pioneer Platforms that Harness Astrophysical Data to Unravel the Universe's Mysteries * 5 PhD Students Named New Frontiers Graduate Fellows * Supercomputer Simulation Reveals Galaxy Development Over 13.8 Billion Years * Inspur Tops SPEC SSD Storage Benchmark * Marvell Reports Second Quarter of Fiscal Year 2022 Financial Results * Entanglement Extends Reach Towards National Science Foundation and Midwest Quantum Academia August 26, 2021 * Dell Technologies Posts Record Second Quarter Results * High Performance Computing Virtual Workshop REX-IO 2021 to be Held September 7 * Engineers Create Double Layer of Borophene for First Time * XTREME-D Launches G4 Instance on Baremetal High-Speed Computing Environment * SambaNova Partners with ORock to Deliver Cloud-Based AI Solutions August 25, 2021 * Asperitas' Immersion Cooling Technology First to Comply with OCP Immersion Requirements * IonQ Debuts Industry's First Reconfigurable Multicore Quantum Architecture * Qumulo and Hewlett Packard Enterprise Deliver High Density File Solution * Quantum Brilliance Raises $9.7 Million Seed Funding to Advance Diamond Quantum Accelerator * Panasas Delivers PanFS9, Its Next-Generation Portable Storage Platform August 24, 2021 * GigaIO Bolsters Executive Sales Leadership with Two Key New Hires * DMTF Shares Widespread Industry Support for its Standards * Synopsys Enables First-Pass Silicon Success for Achronix's New FPGA for Data and AI Acceleration Applications * eTopus Selects Diakopto's ParagonX Platform for Ultra-High-Speed SerDes IP More Off The Wire x Off The Wire Industry Headlines More Off The Wire Subscribe to HPCwire's Weekly Update! Be the most informed person in the room! Stay ahead of the tech trends with industy updates delivered to you every week! * The Latest * Editor's Picks * Most Popular [esperanto-glacier-point-v2] Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip August 27, 2021 Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores onto a package small enough to fit six times over on a single P Read more... [shutterstock_earth_aerial_satellite-405x228] Supercomputing Experts React to Dire Climate Report August 26, 2021 The Intergovernmental Panel on Climate Change (IPCC) recently released the first major component of its Sixth Assessment Report (AR6). The IPCC's first assessment report since 2014, AR6 paints a bleak picture of both t Read more... [bluefield--405x228] Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel August 25, 2021 The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was on display at Hot Chips this week. Arm, Nvidia, and Intel a Read more... [Argonne-Polaris-rendering-cropped_690x-405x228] Argonne's 44-Petaflops 'Polaris' Supercomputer Will Be Testbed for Aurora, Exascale Era August 25, 2021 A new 44-petaflops (theoretical peak) supercomputer is under construction at the Department of Energy's Argonne National Laboratory. Called Polaris, this new supercomputing star has been selected to light the way to ex Read more... [Cerebras-MemoryX-SwarmX-CS-2_banner-405x228] Wafer Scale to 'Brain-Scale' - Cerebras Touts Linear Scaling up to 192 CS-2 Systems August 24, 2021 At the Hot Chips conference today, held as a virtual event, wafer-scale computing company Cerebras Systems unveiled its "brain-scale" approach for running the largest models in the world across up to 192 CS-2 clusters. To enable this, Cerebras is debuting its weight streaming technology, which flips the way that models are usually run, and launching two new products: MemoryX and SwarmX. Read more... AWS Solution Channel [shutterstock_1845571771-405x228] Maximizing Price Performance for NVIDIA's GPU Optimized Seismic Code Kirchhoff Time and Depth Migration Seismic imaging is the process of positioning the Earth's subsurface reflectors. It transforms the seismic data recorded in time at the Earth's surface to an image of the Earth's subsurface. Read more... Visit the AWS Solution Channel Previous: * Stion - a Software as a Service for Cryo-EM data processing on AWS * Bare Metal Performance in the Cloud * Pushing pixels, not data with NICE DCV [IBM-Telum-chip_747x-405x228] IBM's Upcoming Z Series Chip Gains On-Chip AI Acceleration and New Name: Telum August 23, 2021 In a major refresh of its Z Series chips, IBM is adding on-chip AI acceleration capabilities to allow enterprise customers to perform deep learning inferencing while transactions are taking place to capture business insi Read more... [shutterstock_earth_aerial_satellite-405x228] Supercomputing Experts React to Dire Climate Report August 26, 2021 The Intergovernmental Panel on Climate Change (IPCC) recently released the first major component of its Sixth Assessment Report (AR6). The IPCC's first assess Read more... [bluefield--405x228] Hot Chips: Here Come the DPUs and IPUs from Arm, Nvidia and Intel August 25, 2021 The emergence of data processing units (DPU) and infrastructure processing units (IPU) as potentially important pieces in cloud and datacenter architectures was Read more... [Argonne-Polaris-rendering-cropped_690x-405x228] Argonne's 44-Petaflops 'Polaris' Supercomputer Will Be Testbed for Aurora, Exascale Era August 25, 2021 A new 44-petaflops (theoretical peak) supercomputer is under construction at the Department of Energy's Argonne National Laboratory. Called Polaris, this new Read more... [Cerebras-MemoryX-SwarmX-CS-2_banner-405x228] Wafer Scale to 'Brain-Scale' - Cerebras Touts Linear Scaling up to 192 CS-2 Systems August 24, 2021 At the Hot Chips conference today, held as a virtual event, wafer-scale computing company Cerebras Systems unveiled its "brain-scale" approach for running the largest models in the world across up to 192 CS-2 clusters. To enable this, Cerebras is debuting its weight streaming technology, which flips the way that models are usually run, and launching two new products: MemoryX and SwarmX. Read more... [IBM-Telum-chip_747x-405x228] IBM's Upcoming Z Series Chip Gains On-Chip AI Acceleration and New Name: Telum August 23, 2021 In a major refresh of its Z Series chips, IBM is adding on-chip AI acceleration capabilities to allow enterprise customers to perform deep learning inferencing Read more... [shutterstock_arm_hq-405x228] UK Regulatory Agency Says Proposed $40B Nvidia Deal for Arm 'Would Lessen Competition' August 21, 2021 Nvidia's proposed $40 billion acquisition of chip IP vendor Arm has hit a major roadblock after a report from a U.K. regulatory agency criticized the deal, sa Read more... [header-tesla-405x228] Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip August 20, 2021 Two months ago, Tesla revealed a massive GPU cluster that it said was "roughly the number five supercomputer in the world," and which was just a precursor to Tesla's real supercomputing moonshot: the long-rumored, little-detailed Dojo system. "We've been scaling our neural network training compute dramatically over the last few years," said Milan Kovac, Tesla's director of autopilot engineering. Read more... [shutterstock_1026024550-405x228] UK's New Extreme Scale Computing Center to Advance Fusion Energy August 19, 2021 As the world barrels toward a dark climate future, many people's hopes increasingly rest with major technological breakthroughs - including, perhaps most fa Read more... [shutterstock_tsmc-405x228] AMD Chipmaker TSMC to Use AMD Chips for Chipmaking May 8, 2021 TSMC has tapped AMD to support its major manufacturing and R&D workloads. AMD will provide its Epyc Rome 7702P CPUs - with 64 cores operating at a base cl Read more... [next-up-dojo] Ahead of 'Dojo,' Tesla Reveals Its Massive Precursor Supercomputer June 22, 2021 In spring 2019, Tesla made cryptic reference to a project called Dojo, a "super-powerful training computer" for video data processing. Then, in summer 2020, Tesla CEO Elon Musk tweeted: "Tesla is developing a [neural network] training computer called Dojo to process truly vast amounts of video data. It's a beast! ... A truly useful exaflop at de facto FP32." Read more... [NERSC-Perlmutter-phase-1-panels_1000x-405x228] Berkeley Lab Debuts Perlmutter, World's Fastest AI Supercomputer May 27, 2021 A ribbon-cutting ceremony held virtually at Berkeley Lab's National Energy Research Scientific Computing Center (NERSC) today marked the official launch of Perlmutter - aka NERSC-9 - the GPU-accelerated supercomputer built by HPE in partnership with Nvidia and AMD. Read more... [Google-TPU-v4-OK-datacenter-May-2021_534x-405x228] Google Launches TPU v4 AI Chips May 20, 2021 Google CEO Sundar Pichai spoke for only one minute and 42 seconds about the company's latest TPU v4 Tensor Processing Units during his keynote at the Google I Read more... [Rocky-Linux_logo_600x-405x228] CentOS Replacement Rocky Linux Is Now in GA and Under Independent Control June 21, 2021 The Rocky Enterprise Software Foundation (RESF) is announcing the general availability of Rocky Linux, release 8.4, designed as a drop-in replacement for the soon-to-be discontinued CentOS. The GA release is launching six-and-a-half months after Red Hat deprecated its support for the widely popular, free CentOS server operating system. The Rocky Linux development effort... Read more... [header-tesla-405x228] Enter Dojo: Tesla Reveals Design for Modular Supercomputer & D1 Chip August 20, 2021 Two months ago, Tesla revealed a massive GPU cluster that it said was "roughly the number five supercomputer in the world," and which was just a precursor to Tesla's real supercomputing moonshot: the long-rumored, little-detailed Dojo system. "We've been scaling our neural network training compute dramatically over the last few years," said Milan Kovac, Tesla's director of autopilot engineering. Read more... [Iran-flag_shutterstock-641676568_700x462-405x228] Iran Gains HPC Capabilities with Launch of 'Simorgh' Supercomputer May 18, 2021 Iran is said to be developing domestic supercomputing technology to advance the processing of scientific, economic, political and military data, and to strengthen the nation's position in the age of AI and big data. On Sunday, Iran unveiled the Simorgh supercomputer, which will deliver.... Read more... [shutterstock_237797614-405x228] Intel Completes LLVM Adoption; Will End Updates to Classic C/C++ Compilers in Future August 10, 2021 Intel reported in a blog this week that its adoption of the open source LLVM architecture for Intel's C/C++ compiler is complete. The transition is part of In Read more... Leading Solution Providers Altair AMD Ansys Arm Aspen Systems Atempo Atos AWS Bright Computing CoolIT Cornelis Networks DDN Dell DUG Fujitsu HPE Inspur Intel Lenovo Motivair NEC Oracle Pavilion QCT Silicon Mechanics Tintri TotalCAE Contributors Tiffany Trader Tiffany Trader Managing Editor John Russell John Russell Editor Oliver Peckham Oliver Peckham Editor Mariana Iriarte Mariana Iriarte Contributing Editor Todd Weiss Todd R. Weiss Contributing Editor Addison Snell Addison Snell Contributing Editor Alex Woodie Alex Woodie Contributing Editor [decade_eve] Click Here for More Headlines More Editor's Picks [Intel-Ice-Lake-wafer-and-CPU_735x-405x228] Intel Launches 10nm 'Ice Lake' Datacenter CPU with Up to 40 Cores April 6, 2021 The wait is over. Today Intel officially launched its 10nm datacenter CPU, the third-generation Intel Xeon Scalable processor, codenamed Ice Lake. With up to 40 Read more... [chip_processor_abstract_shutterstock-331017803_700x-405x] 10nm, 7nm, 5nm.... Should the Chip Nanometer Metric Be Replaced? June 1, 2020 The biggest cool factor in server chips is the nanometer. AMD beating Intel to a CPU built on a 7nm process node* - with 5nm and 3nm on the way - has been i Read more... [AMD-Xilinx_549x-405x228] AMD-Xilinx Deal Gains UK, EU Approvals -- China's Decision Still Pending July 1, 2021 AMD's planned acquisition of FPGA maker Xilinx is now in the hands of Chinese regulators after needed antitrust approvals for the $35 billion deal were receiv Read more... [Julia-colorful-pixel-packing_800x-405x228] Julia Update: Adoption Keeps Climbing; Is It a Python Challenger? January 13, 2021 The rapid adoption of Julia, the open source, high level programing language with roots at MIT, shows no sign of slowing according to data from Julialang.org. I Read more... [esperanto-glacier-point-v2] Esperanto, Silicon in Hand, Champions the Efficiency of Its 1,092-Core RISC-V Chip August 27, 2021 Esperanto Technologies made waves last December when it announced ET-SoC-1, a new RISC-V-based chip aimed at machine learning that packed nearly 1,100 cores ont Read more... [ibm-quantum-interior-405x228] Quantum Roundup: IBM, Rigetti, Phasecraft, Oxford QC, China, and More July 13, 2021 IBM yesterday announced a proof for a quantum ML algorithm. A week ago, it unveiled a new topology for its quantum processors. Last Friday, the Technical Univer Read more... [ORNL-Frontier_700x-405x228] Frontier to Meet 20MW Exascale Power Target Set by DARPA in 2008 July 14, 2021 After more than a decade of planning, the United States' first exascale computer, Frontier, is set to arrive at Oak Ridge National Laboratory (ORNL) later this year. Crossing this "1,000x" horizon required overcoming four major challenges: power demand, reliability, extreme parallelism and data movement. Read more... [Intel-7-product-slide-405x228] Intel Unveils New Node Names; Sapphire Rapids Is Now an 'Intel 7' CPU July 27, 2021 What's a preeminent chip company to do when its process node technology lags the competition by (roughly) one generation, but outmoded naming conventions make it seem like it's two nodes behind? For Intel, the response was to change how it refers to its nodes with the aim of better reflecting its positioning within the leadership semiconductor manufacturing space. Intel revealed its new node nomenclature, and... Read more... * arrow * Click Here for More Headlines * arrow [hpcwire_lo] Technologies: * Applications * Cloud * Developer Tools * Interconnects * Middleware * Networks * Processors * Storage * Systems * Visualization Sectors: * Academia & Research * Business * Entertainment * Financial Services * Government * Life Sciences * Manufacturing * Oil & Gas * Retail * Exascale * Multimedia * Events * Organizations and Affiliations * Editorial Submissions * Subscribe * About HPCwire * Contact Us * Sitemap * Reprints [tabor_logo] The Information Nexus of Advanced Computing and Data systems for a High Performance World * TCI Home * Our Publications * Solutions * Live Events * Press * Privacy Policy * Cookie Policy * About Tabor Communications * Update Subscription Preferences * California Consumers (c) 2021 HPCwire. All Rights Reserved. A Tabor Communications Publication HPCwire is a registered trademark of Tabor Communications, Inc. Use of this site is governed by our Terms of Use and Privacy Policy. Reproduction in whole or in part in any form or medium without express written permission of Tabor Communications, Inc. is prohibited. HPCwire This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.Accept Reject Read More Privacy & Cookies Policy Close Privacy Overview This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience. Necessary [*] Necessary Always Enabled Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information. Non-necessary [*] Non-necessary Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website. SAVE & ACCEPT