Subj : AWS is working on proprietary innovative cooling tech to use on N
To   : All
From : TechnologyDaily
Date : Sat Jul 12 2025 12:30:09

AWS is working on proprietary innovative cooling tech to use on Nvidia GPUs 
for now  I wouldn't be surprised if Graviton chips get it as well

Date:
Sat, 12 Jul 2025 11:27:00 +0000

Description:
Amazon built a new custom liquid cooling system to support Nvidias GB200 
NVL72 GPUs.

FULL STORY
======================================================================AWS 
built custom Nvidia cooling after rejecting existing liquid solutions for 
scale IRHX fits into AWS racks without changes to existing infrastructure 
Amazon could extend this cooling approach to Graviton chips in the future 

Amazon Web Services (AWS) has introduced a proprietary cooling system built 
to handle the demands of Nvidias newest GPUs. 

The In-Row Heat Exchanger, or IRHX, was developed in response to the growing 
power and heat requirements of hardware like the Nvidia GB200 NVL72. 

AWS evaluated existing liquid cooling solutions but found they didnt fit the 
companys needs. AWS Graviton next? 

They would take up too much data center floor space, would still require 
major modifications to data centers, or increase water usage substantially, 
Dave Brown, VP Compute and ML Services at AWS, said in a presentation posted 
on YouTube, which you can see below. 

And while some of these solutions could work for lower volumes at other 
providers, they simply wouldn't be enough liquid cooling capacity to support 
our scale. 

The IRHX system consists of a pumping unit, a water distribution cabinet, and 
fan coils. 

Liquid cools the chips through a cold plate co-designed by AWS and Nvidia, 
then cycles back through the IRHX, where it is cooled and released. 

With the IRHX we dont need to design the data center around the rack, Brown 
said. 

The system supports AWSs most powerful EC2 instance, the P6e UltraServer, 
which includes the GB200 NVL72. This rack-scale setup allows 72 Blackwell 
GPUs to work together as one unit. 

Brown said the GB200 NVL72 enables 72 Nvidia Blackwell GPUs to act as a 
single massive GPU. 

Amazon has previously built custom hardware, including chips and networking 
systems. The IRHX extends that strategy into cooling, allowing AWS to deploy 
new GPU racks without redesigning its facilities. 

The company said the system fits existing rack dimensions and infrastructure, 
making it scalable across global data centers. 

While IRHX is currently paired with Nvidias Blackwell-based systems, it is 
likely to be used with Amazons own Graviton chips if their cooling needs 
rise. 

For now, the system is powering AI workloads that demand both scale and 
speed. You might also like AWS says customers are turning back to on-prem 
These are best dedicated hosting services you can get right now AWS reveals 
European Sovereign Cloud to allay fears about US providers



======================================================================
Link to news story:
https://www.techradar.com/pro/aws-is-working-on-proprietary-innovative-cooling
-tech-to-use-on-nvidia-gpus-for-now-i-wouldnt-be-surprised-if-graviton-chips-g
et-it-as-well


--- Mystic BBS v1.12 A47 (Linux/64)
 * Origin: tqwNet Technology News (1337:1/100)

.