https://www.hpcwire.com/off-the-wire/los-alamos-achieves-yottabyte-scale-data-compression-in-neutron-transport-equations/ Search the site [ ] Go Tabor Network: * [d] Datanami * [e] EnterpriseAI * [hpcwj_favi] HPCwire Japan * # QCwire * # HPC & AI Wall Street Toggle navigation [hpcwire_lo] Search the site [ ] Go Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them Since 1987 - Covering the Fastest Computers in the World and the People Who Run Them * Home * Topics + Applications + Cloud + Developer Tools + Interconnects + Middleware + Networks + Processors + Quantum + Storage + Systems + Visualization * Sectors + Academia & Research + Entertainment + Financial Services + Government + Life Sciences + Manufacturing + Oil & Gas + Retail * QCwire Home * QCwire Subscribe * Exascale * Specials + LIVEwire Interviews + SC o 2023 o 2022 o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 o 2009 o 2008 + ISC o 2024 o 2023 o 2022 o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 o 2009 o 2008 + People to Watch o 2024 o 2023 o 2022 o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 + Readers' Choice Awards o 2023 o 2022 o 2021 o 2020 o 2019 o 2018 o 2017 o 2016 o 2015 o 2014 o 2013 o 2012 o 2011 o 2010 + HPC + AI Wall Street o 2018 o 2009 o 2008 + Advanced Scale Forum * Resource Library * Podcast * Events + Events + Advanced Scale Forum + HPC + AI Wall Street o 2022 Digital Event Series * Job Bank * About + About HPCwire + Organizations and Affiliations + Customer Testimonials + HPCwire Editorial Submissions + Subscribe + HPCwire Custom Reprints + Contact Us * Subscribe ISC24 coverage Los Alamos Achieves Yottabyte-Scale Data Compression in Neutron Transport Equations May 22, 2024 May 22, 2024 -- Researchers at Los Alamos National Laboratory have developed a tensor network approach that solves real-world neutron transport equations. As described in the Journal of Computational Physics, the approach achieved world-record compression of memory, on the yottabyte scale -- yottabytes are the largest unit of measurement and equivalent to a million trillion megabytes -- and demonstrated efficiency and accuracy in solving partial differential equations used in critical nuclear science applications. [binary-matrix_shutterstock-130286171_1000]Credit: Shutterstock "Tensor network techniques are forming a new frontier of mathematical modeling that enable numerical solutions of high-dimensional partial differential equations at unprecedented speed," said Duc Truong, Los Alamos researcher on the project. Breaking the Curse of Dimensionality The team's tensor network approach uses data science and machine learning (an application of artificial intelligence) to break the "curse of dimensionality," the multiple issues that arise with increased dimensionality in large computational tasks. Even high-performance computers are limited by the curse of dimensionality. The researchers developed a mixed tensor-train (TT) plus quantized tensor-train (QTT) method and applied it to a specific task: solving the time-independent Boltzmann neutron transport equations in Cartesian geometry. These three-dimensional equations describe neutron transport resulting from collisions with atoms; one learns how fast the neutrons are moving and where they are going. "Used in neutron transport models, tensor network techniques may help unlock neutron behavior in many settings," said Mario Ortega, fellow Los Alamos researcher. "Neutron transport equations are useful in understanding processes in nuclear reactors and in particle beams employed in science and industry." Achieving Record Compression The team validated their approach using two examples of three-dimensional neutron transport problems, currently solved by the Laboratory's PARallel time-dependent discrete ordinate (PARTISN) code, developed over decades to address neutron transport problems. Executing the TT/QTT method on a standard desktop computer, the team achieved the record of compressing the storage of terabyte-sized neutron flow to megabytes. That compression was achieved while enabling full access to megabyte-sized tensor network representations of yottabyte-sized transport matrix operators. The TT/QTT method also exhibited exceptional efficiency in compute time and memory usage, significantly outperforming the PARTISN code. "When comparing the mixed tensor train plus quantized tensor train approach against traditional methods for solving Boltzmann neutron transport equations, we found that efficiency, speed, memory and accuracy all favor the new approach," said Boian Alexandrov, the senior scientist of the project. The research team aims to extend their approach to study problems with multiple materials and the use of tensor networks with spherical and cylindrical neutron transport equations with non-linearity. Paper: "Tensor networks for solving the time-independent Boltzmann neutron transport equation." Journal of Computational Physics. DOI: 10.1016/j.jcp.2024.112943 Funding: This work was supported by the Laboratory Directed Research and Development program of Los Alamos National Laboratory, and in part by Institutional Computing Program at Los Alamos. --------------------------------------------------------------------- Source: LANL Leading Solution Providers Altair AMD Amphenol Ansys Aspen Systems AWS CGG CIQ CoolIT Cornelis Networks DDN Dell Google Hammerspace HPE Intel KAYTUS Lenovo Microsoft Motivair NEC Nvidia Penguin Solution TotalCAE [hpcw-35for] [HPCW-isc24] * Off The Wire * Industry Headlines * May 24, 2024 * Microsoft and G42 Announce $1 Billion AI and Cloud Initiative in East Africa * UConn Geoscientist Earns NAIRR Pilot Support for AI Water Flow Research * Jefferson Lab-led Venture Explores Merits of Entangled Ions in Quantum Computing * LLNL Researchers Develop Framework for Databasing Properties of Crystal Defects * EuroHPC Expands Objectives to Include AI Factories for Boosting EU's AI Ecosystem * BSC's STAR Group Announces New Features in 2024.05 Release * LTO Tape Capacity Shipments Achieve Significant Growth Amid Explosive Data Generation May 23, 2024 * DDN Partners with Ooredoo to Enhance Qatar's Digital Infrastructure with Sovereign AI * Lenovo Reports $13.8B Q4 Revenue and $248M Net Income * Agnostiq Introduces AI Model Training and Serving Capabilities in Covalent Platform * NCSA: SPIN Offers Real-World Applications to Students * IQM Quantum Computers Expands Access to IQM Garnet Through AWS * Alice & Bob's Cat Qubit Research Published in Nature * Adaptive Computing and X-ScaleSolutions Sign Strategic Partnership Agreement May 22, 2024 * Los Alamos Achieves Yottabyte-Scale Data Compression in Neutron Transport Equations * GIGABYTE Announces Support for AMD EPYC 4004 Series Processors * VAST Data Drives Innovation with Taiga Cloud Partnership for Scalable AI Services * QuSecure Achieves SOC 1 and SOC 2 Type 2 Compliance, Validating Security of QuProtect Software Solution * MSI Expands Server Offerings with AMD EPYC 4004 CPUs to Support Small and Medium Businesses * LuxProvide and ICHEC Forge Strategic Partnership to Advance HPC in Europe More Off The Wire x Off The Wire Industry Headlines More Off The Wire Subscribe to HPCwire's Weekly Update! Be the most informed person in the room! Stay ahead of the tech trends with industry updates delivered to you every week! * The Latest * Editor's Picks [ISC-2024-Entrance-close2-405x228] ISC 2024 Takeaways: Love for Top500, Extending HPC Systems, and Media Bashing May 23, 2024 The ISC High Performance show is typically about time-to-science, but breakout sessions also focused on Europe's tech sovereignty, server infrastructure, storage, throughput, and new computing technologies. This round Read more... [1200px-Gordon_Bell-405x228] HPC Pioneer Gordon Bell Passed Away May 22, 2024 Legendary computer scientist Gordon Bell passed away last Friday at his home in Coronado, CA. He was 89. The New York Times has a nice tribute piece. A long-time pioneer with Digital Equipment Corp, he pushed hard for de Read more... [IQM-quantum-system-405x228] ISC 2024 -- A Few Quantum Gems and Slides from a Packed QC Agenda May 22, 2024 If you were looking for quantum computing content, ISC 2024 was a good place to be last week -- there were around 20 quantum computing related sessions. QC even earned a slide in Kathy Yelick's opening keynote -- Bey Read more... [shutterstock_europe_tech-405x228] Atos Outlines Plans to Get Acquired, and a Path Forward May 21, 2024 Atos - via its subsidiary Eviden - is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more... Shutterstock 1194728515 Core42 Is Building Its 172 Million-core AI Supercomputer in Texas May 20, 2024 UAE-based Core42 is building an AI supercomputer with 172 million cores which will become operational later this year. The system, Condor Galaxy 3, was announced earlier this year and will have 192 nodes with Cerebras Read more... [chip-concept_shutterstock-2125659005_1000x-405x228] Google Announces Sixth-generation AI Chip, a TPU Called Trillium May 17, 2024 On Tuesday May 14th, Google announced its sixth-generation TPU (tensor processing unit) called Trillium. The chip, essentially a TPU v6, is the company's latest weapon in the AI battle with GPU maker Nvidia and clou Read more... [ISC-2024-Entrance-close2-405x228] ISC 2024 Takeaways: Love for Top500, Extending HPC Systems, and Media Bashing May 23, 2024 The ISC High Performance show is typically about time-to-science, but breakout sessions also focused on Europe's tech sovereignty, server infrastructure, storag Read more... [IQM-quantum-system-405x228] ISC 2024 -- A Few Quantum Gems and Slides from a Packed QC Agenda May 22, 2024 If you were looking for quantum computing content, ISC 2024 was a good place to be last week -- there were around 20 quantum computing related sessions. QC eve Read more... [shutterstock_europe_tech-405x228] Atos Outlines Plans to Get Acquired, and a Path Forward May 21, 2024 Atos - via its subsidiary Eviden - is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more... [chip-concept_shutterstock-2125659005_1000x-405x228] Google Announces Sixth-generation AI Chip, a TPU Called Trillium May 17, 2024 On Tuesday May 14th, Google announced its sixth-generation TPU (tensor processing unit) called Trillium. The chip, essentially a TPU v6, is the company's l Read more... [ISC-2024-Session-Shot-405x228] Europe's Race towards Quantum-HPC Integration and Quantum Advantage May 16, 2024 What an interesting panel, Quantum Advantage -- Where are We and What is Needed? While the panelists looked slightly weary -- their's was, after all, one of Read more... [5-15-2024pexels-photo-8386440-405x228] The Future of AI in Science May 15, 2024 AI is one of the most transformative and valuable scientific tools ever developed. By harnessing vast amounts of data and computational power, AI systems can un Read more... [CPA_Aurora-Image_16x9-405x228] Some Reasons Why Aurora Didn't Take First Place in the Top500 List May 15, 2024 The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more... [ISC-2024-Entrance-405x228] ISC 2024 Keynote: High-precision Computing Will Be a Foundation for AI Models May 15, 2024 Some scientific computing applications cannot sacrifice accuracy and will always require high-precision computing. Therefore, conventional high-performance c Read more... [handshake-x650-405x228] Synopsys Eats Ansys: Does HPC Get Indigestion? February 8, 2024 Recently, it was announced that Synopsys is buying HPC tool developer Ansys. Started in Pittsburgh, Pa., in 1970 as Swanson Analysis Systems, Inc. (SASI) by John Swanson (and eventually renamed), Ansys serves the CAE (Computer Aided Engineering)/multiphysics engineering simulation market. Read more... [Nvidia-Hopper-arch-H100-SXM_942x-405x228] Nvidia H100: Are 550,000 GPUs Enough for This Year? August 17, 2023 The GPU Squeeze continues to place a premium on Nvidia H100 GPUs. In a recent Financial Times article, Nvidia reports that it expects to ship 550,000 of its lat Read more... [shutterstock_2198551419-405x228] Comparing NVIDIA A100 and NVIDIA L40S: Which GPU is Ideal for AI and Graphics-Intensive Workloads? October 30, 2023 With long lead times for the NVIDIA H100 and A100 GPUs, many organizations are looking at the new NVIDIA L40S GPU, which it's a new GPU optimized for AI and g Read more... [shutterstock_europe_tech-405x228] Atos Outlines Plans to Get Acquired, and a Path Forward May 21, 2024 Atos - via its subsidiary Eviden - is the second major supercomputer maker outside of HPE, while others have largely dropped out. The lack of integrators and Atos' financial turmoil have the HPC market worried. If Atos goes under, HPE will be the only major option for building large-scale systems. Read more... [shutterstock_2328020525-405x228] Choosing the Right GPU for LLM Inference and Training December 11, 2023 Accelerating the training and inference processes of deep learning models is crucial for unleashing their true potential and NVIDIA GPUs have emerged as a game- Read more... Shutterstock 1606064203 Meta's Zuckerberg Puts Its AI Future in the Hands of 600,000 GPUs January 25, 2024 In under two minutes, Meta's CEO, Mark Zuckerberg, laid out the company's AI plans, which included a plan to build an artificial intelligence system with the eq Read more... AMD MI3000A How AMD May Get Across the CUDA Moat October 5, 2023 When discussing GenAI, the term "GPU" almost always enters the conversation and the topic often moves toward performance and access. Interestingly, the word "GPU" is assumed to mean "Nvidia" products. (As an aside, the popular Nvidia hardware used in GenAI are not technically... Read more... [gtc24-spring-web-browser-notification-sjcc-1280x680-1-e1] Nvidia's New Blackwell GPU Can Train AI Models with Trillions of Parameters March 18, 2024 Nvidia's latest and fastest GPU, codenamed Blackwell, is here and will underpin the company's AI plans this year. The chip offers performance improvements from Read more... Leading Solution Providers Altair AMD Amphenol Ansys Aspen Systems AWS CGG CIQ CoolIT Cornelis Networks DDN Dell Google Hammerspace HPE Intel KAYTUS Lenovo Microsoft Motivair NEC Nvidia Penguin Solution TotalCAE Contributors Tiffany Trader Tiffany Trader Editorial Director Douglas Eadline Douglas Eadline Managing Editor John Russell John Russell Senior Editor Kevin Jackson Kevin Jackson Contributing Editor Ali Azhar Ali Azhar Contributing Editor Alex Woodie Alex Woodie Contributing Editor Addison Snell Addison Snell Contributing Editor Drew Jolly Drew Jolly Assistant Editor [hpcw-35for] [HPCW-isc24] Click Here for More Headlines More Editor's Picks [CPA_Aurora-Image_16x9-405x228] Some Reasons Why Aurora Didn't Take First Place in the Top500 List May 15, 2024 The makers of the Aurora supercomputer, which is housed at the Argonne National Laboratory, gave some reasons why the system didn't make the top spot on the Top Read more... [thumbnail_D-Wave_Advantage2Prototype_Z6-405x228] Eyes on the Quantum Prize - D-Wave Says its Time is Now January 30, 2024 Early quantum computing pioneer D-Wave again asserted - that at least for D-Wave - the commercial quantum era has begun. Speaking at its first in-person Ana Read more... [datacenter-concept_shutterstock-1926689759_800x-405x228] The GenAI Datacenter Squeeze Is Here February 1, 2024 The immediate effect of the GenAI GPU Squeeze was to reduce availability, either direct purchase or cloud access, increase cost, and push demand through the roof. A secondary issue has been developing over the last several years. Even though your organization secured several racks... Read more... Shutterstock 1285747942 AMD's Horsepower-packed MI300X GPU Beats Nvidia's Upcoming H200 December 7, 2023 AMD and Nvidia are locked in an AI performance battle - much like the gaming GPU performance clash the companies have waged for decades. AMD has claimed it Read more... [Blak-Hole-main-405x228] The NASA Black Hole Plunge May 7, 2024 We have all thought about it. No one has done it, but now, thanks to HPC, we see what it looks like. Hold on to your feet because NASA has released videos of wh Read more... [Falcon-Shores-XPU_900x-e1714425207172-405x228] Intel Plans Falcon Shores 2 GPU Supercomputing Chip for 2026 August 8, 2023 Intel is planning to onboard a new version of the Falcon Shores chip in 2026, which is code-named Falcon Shores 2. The new product was announced by CEO Pat Gel Read more... [workers_shutterstock_rawpixel-405x228] GenAI Having Major Impact on Data Culture, Survey Says February 21, 2024 While 2023 was the year of GenAI, the adoption rates for GenAI did not match expectations. Most organizations are continuing to invest in GenAI but are yet to Read more... [shutterstock_battery-405x228] How the Chip Industry is Helping a Battery Company May 8, 2024 Chip companies, once seen as engineering pure plays, are now at the center of geopolitical intrigue. Chip manufacturing firms, especially TSMC and Intel, have b Read more... * arrow * Click Here for More Headlines * arrow [hpcwire_lo] Technologies: * Applications * Cloud * Developer Tools * Interconnects * Middleware * Networks * Processors * Storage * Systems * Visualization Sectors: * Academia & Research * Business * Entertainment * Financial Services * Government * Life Sciences * Manufacturing * Oil & Gas * Retail * Exascale * Multimedia * Events * Organizations and Affiliations * Editorial Submissions * Subscribe * About HPCwire * Contact Us * Sitemap * Reprints [tabor_logo] The Information Nexus of Advanced Computing and Data systems for a High Performance World * TCI Home * Our Publications * Solutions * Live Events * Press * Privacy Policy * Cookie Policy * About Tabor Communications * Update Subscription Preferences * California Consumers (c) 2024 HPCwire. All Rights Reserved. A Tabor Communications Publication HPCwire is a registered trademark of Tabor Communications, Inc. Use of this site is governed by our Terms of Use and Privacy Policy. Reproduction in whole or in part in any form or medium without express written permission of Tabor Communications, Inc. is prohibited. HPCwire This website uses cookies to improve your experience. We'll assume you're ok with this, but you can opt-out if you wish.Accept Reject Read More Privacy & Cookies Policy Close Privacy Overview This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience. Necessary [*] Necessary Always Enabled Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information. Non-necessary [*] Non-necessary Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website. SAVE & ACCEPT Share Blogger Delicious Digg Email Facebook Facebook messenger Google Hacker News Line LinkedIn Mix Odnoklassniki PDF Pinterest Pocket Print Reddit Renren Short link SMS Skype Telegram Tumblr Twitter VKontakte wechat Weibo WhatsApp Xing Yahoo! Mail Copy short link [ ]Copy link