Subj : Samsung's biggest rival and Sandisk have come together to standar To : All From : TechnologyDaily Date : Tue Aug 12 2025 21:15:08 Samsung's biggest rival and Sandisk have come together to standardize High Bandwidth Flash memory - which could mean better AI performance for everyone Date: Tue, 12 Aug 2025 20:05:00 +0000 Description: Sandisk and SK Hynix developing High Bandwidth Flash, a hybrid memory design combining DRAM-like speed with NAND capacity to expand AI performance and efficiency. FULL STORY ======================================================================Sandisk and SK Hynix propose flash-powered high-bandwidth memory to handle larger AI models High Bandwidth Flash could store far more data than DRAM-based HBM for AI workloads Energy savings from NANDs non-volatility could reshape AI data center cooling strategies Sandisk and SK Hynix have signed an agreement to develop a memory technology which could change how AI accelerators handle data at scale. The companies aim to standardize High Bandwidth Flash (HBF), a NAND -based alternative to traditional high-bandwidth memory used in AI GPUs. The concept builds on packaging designs similar to HBM while replacing part of the DRAM stack with flash, trading some latency for vastly increased capacity and non-volatility. AI memory stacks to handle larger models at lower power demands This approach allows HBF to provide between eight and sixteen times the storage of DRAM-based HBM at roughly similar costs. NANDs ability to retain data without constant power also brings potential energy savings, an increasingly important factor as AI inference expands into environments with strict power and cooling limits. For hyperscale operators running large models, the change could help address both thermal and budget constraints that are already straining data center operations. This plan aligns with a research concept titled LLM in a Flash, which outlined how large language models could run more efficiently by incorporating SSDs as an additional tier, alleviating pressure on DRAM. HBF essentially integrates that logic into a single high-bandwidth package, potentially combining the storage scale of the largest SSD with the speed profile needed for AI workloads. Sandisk presented its HBF prototype at the Flash Memory Summit 2025, using proprietary BiCS NAND and wafer bonding techniques. Sample modules are expected in the second half of 2026, with the first AI hardware using HBF projected for early 2027. No specific product partnerships have been disclosed, but SK Hynixs position as a major memory supplier to leading AI chipmakers, including Nvidia, could accelerate adoption once standards are finalized. This move also comes as other manufacturers explore similar ideas. Samsung has announced flash-backed AI storage tiers and continues to develop HBM4 DRAM, while companies like Nvidia remain committed to DRAM-heavy designs. If successful, the Sandisk and SK Hynix collaboration could create heterogeneous memory stacks where DRAM, flash, and other persistent storage types coexist. Via Toms Hardware You might also like Forget talking to a human ever again - Apple is rolling out AI chatbots in its customer service app These are the best business laptops available to buy right now And you should take a look at the best office chairs we've tried ====================================================================== Link to news story: https://www.techradar.com/pro/sandisk-and-samsungs-biggest-rival-have-come-tog ether-to-standardize-high-bandwidth-flash-memory-and-it-could-mean-greater-ai- performance-for-everyone --- Mystic BBS v1.12 A49 (Linux/64) * Origin: tqwNet Technology News (1337:1/100) .