https://www.anandtech.com/show/21172/amazon-unveils-graviton4-a-96core-cpu-with-5367-gbs-memory-bandwidth [p] [logo2] [ ] [search] Welcome Log out Login Register [icon-twitt] [icon-faceb] [icon-rss] * ABOUT * BENCH * FORUMS * PODCAST [logo_resp] [ ] [search] ABOUT BENCH FORUMS PODCAST LOGIN REGISTER PC ComponentsV * CPUs * GPUs * Motherboards * SSDs * Cases/Cooling/PSUs * Memory * NAS * Storage Smartphones & tabletsV * Smartphones * Tablets * Huawei * HTC * Samsung * Google/Android * Microsoft * Apple * SoCs SystemsV * Notebook Reviews * Desktop Reviews * Mac Reviews * Ultrabooks ENTERPRISE & IT GUIDESV * Best CPUs * Best SSDs * Best Laptops * Best Android Phones * Best Video Cards * Best PSUs * Best Motherboards * Best Gaming Laptops * Best Mechanical Keyboards * Best Consumer HDDs DEALS * Home> CPUs [ ] Menu * PC ComponentsV + CPUs + GPUs + Motherboards + SSDs + Cases/Cooling/PSUs + Memory + NAS + Storage * Smartphones & tabletsV + Smartphones + Tablets + Huawei + HTC + Samsung + Google/Android + Microsoft + Apple + SoCs * SystemsV + Notebook Reviews + Desktop Reviews + Mac Reviews + Ultrabooks * Enterprise & IT * GuidesV + Best CPUs + Best SSDs + Best Laptops + Best Android Phones + Best Video Cards + Best PSUs + Best Motherboards + Best Gaming Laptops + Best Mechanical Keyboards + Best Consumer HDDs * Deals * TRENDING TOPICS * CPUs * AMD * Intel * GPUs * Storage * SSDs * Mobile * Motherboards * Smartphones * Home> * CPUs Amazon Unveils Graviton4: A 96-Core ARM CPU with 536.7 GBps Memory Bandwidth by Anton Shilov on November 29, 2023 4:30 PM EST * Posted in * CPUs * Arm * Datacenter * Amazon * AWS * Neoverse V2 * Graviton4 * Graviton 3 Comments | Add A Comment 3 Comments + Add A Comment [amazon-aws] Nowadays many cloud service providers design their own silicon, but Amazon Web Services (AWS) started to do this ahead of its rivals and by now its Annapurna Labs develops processors that can well compete with those from AMD and Intel. This week AWS introduced its Graviton4, a 96-core ARM-based system-on-chip (SoC) that promises to challenge renowned CPU designers and offer unprecedented performance to AWS clients. "By focusing our chip designs on real workloads that matter to customers, we are able to deliver the most advanced cloud infrastructure to them," said David Brown, vice president of Compute and Networking at AWS. "Graviton4 marks the fourth generation we have delivered in just five years, and is the most powerful and energy efficient chip we have ever built for a broad range of workloads." The AWS Graviton4 processor packs 96 cores that offer on average 30% higher compute performance compared to Graviton3 and is 40% faster in database applications as well as 45% faster in Java applications, according to Amazon. Given that Amazon did not reveal many details about its Graviton4, it is hard to attribute performance increases to any particular characteristics of the CPU. Yet, NextPlatform believes that the processor uses Arm Neoverse V2 cores, which are more capable than V1 cores used in previous-generation AWS processors when it comes to instruction per clock (IPC). Furthermore, the new CPU is expected to be fabricated using one of TSMC's N4 process technologies (4nm-class), which offers a higher clock-speed potential than TSMC's N5 nodes. "AWS Graviton4 instances are the fastest EC2 instances we have ever tested, and they are delivering outstanding performance across our most competitive and latency sensitive workloads," said Roman Visintine, lead cloud engineer at Epic. "We look forward to using Graviton4 to improve player experience and expand what is possible within Fortnite." In addition, the new processor features a revamped memory subsystem with a 536.7 GB/s peak bandwidth, which is 75% higher compared to the previous-generation AWS CPU. Higher memory bandwidth improves performance of CPUs in memory intensive applications, such as databases. Meanwhile, such a major memory bandwidth improvement indicates that the new processor employs a memory subsystem with a higher number of channels compared to Graviton3, though AWS has not formally confirmed this. Graviton4 will be featured in memory-optimized Amazon EC2 R8g instances, which is particularly useful to boost performance in high-end databases and analytics. Furthermore, these R8g instances provide up to three times more vCPUs and memory than Graviton 3-based R7g instances, enabling higher throughput for data processing, better scalability, faster results, and reduced costs. To ensure security of AWS EC2 instances, Amazon equipped all high-speed physical hardware interfaces of Graviton4 CPUs. It should be noted that Amazon offers up to 64 vCPU cores with its R7g instances (i.e., one full Graviton3 CPU). Therefore, to offer 192 vCPU cores, Amazon will need to either install two 96-core CPUs into one server (which marks one of the world's first Armv9-based 2-way server design), enable three-way SMT on a 96-core CPU, or implement a very low-latency high-bandwidth interconnection between servers running 96-core cPUs. Graviton4 R8g is currently in preview, these instances will be available widely in the coming months. Sources: AWS, NextPlatform PRINT THIS ARTICLE * Post Your Comment [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Please log in or sign up to comment. [ ] [Submit Comment] [ajax-loade] POST A COMMENT 3 Comments View All Comments * SarahKerrigan - Wednesday, November 29, 2023 - link "Meanwhile, such a major memory bandwidth improvement indicates that the new processor employs a memory subsystem with a higher number of channels compared to Graviton3, though AWS has not formally confirmed this." "Given that Amazon did not reveal many details about its Graviton4, it is hard to attribute performance increases to any particular characteristics of the CPU. Yet, NextPlatform believes that the processor uses Arm Neoverse V2 cores, which are more capable than V1 cores used in previous-generation AWS processors when it comes to instruction per clock (IPC). Furthermore, the new CPU is expected to be fabricated using one of TSMC's N4 process technologies (4nm-class), which offers a higher clock-speed potential than TSMC's N5 nodes." https://aws.amazon.com/blogs/aws/join-the-preview-... I don't know why the writer is acting like the uarch and memory are some kind of mystery worthy of speculation. Amazon says outright that it's Neoverse V2 and has 12-channel DDR5-5600. Reply * bwj - Wednesday, November 29, 2023 - link It's great, abstractly, if these are power efficient, but since you can't buy these it only matters to Jeff Bezos. For the rest of us, we only care about the sticker price. Reply * snird - Wednesday, November 29, 2023 - link One of the employees in the team developing Graviton4 is kidnapped by Hamas in Gaza. Amazon management lacks the morals to even mention it: https://www-geektime-co-il.translate.goog/amazon-a... Reply * 1 PIPELINE STORIES + Submit News Amazon Unveils Graviton4: A 96-Core ARM CPU with 536.7 GBps Memory Bandwidth [dell_revea] AT Deals: MSI Codex R RTX 4060 Gaming Desktop Only $700 at Walmart Best Portable SSDs: Holiday 2023 * AT Deals: Samsung T9 Portable 2TB SSD Only $149 at Amazon * Asus Intros GeForce RTX 4060 Ti Video Card With Integrated M.2 SSD Slot * G.Skill and V-Color Unveil Factory Overclocked ECC RDIMMs for Ryzen Threadripper 7000 [UPDATED] * Best PC Power Supplies: Cyber Monday 2023 * Best Internal Hard Drives: Holiday 2023 * AMD's 96-Core Ryzen Threadripper Pro 7995WX Hits 6.0 GHz on All Cores with LN2 * Western Digital Releases 24TB Ultrastar & Gold Hard Drives, 28TB SMR Drives Ramping * Corsair Releases MP700 Pro SSDs: Up 12.4 GB/s With Three Cooling Options * SK hynix Ships LPDDR5T: 9600 MT/s Memory for Smartphones LINKS * Home * About * Forums * RSS * Pipeline News * Bench * Terms of Use * Contact Us * * TOPICS * CPUs * Motherboards * SSD/HDD * GPUs * Mobile * Enterprise & IT * Smartphones * Memory * Cases/Cooling/PSU(s) * Displays * Mac * Systems * Cloud * Trade Shows * Guides FOLLOW * [icon-faceb]Facebook * [icon-twitt]Twitter * [icon-rss2]RSS The Most Trusted in Tech Since 1997 * About * Advertising * Privacy Policy purch Copyright (c) 2023. All rights reserved. * TOPICS * FOLLOW * ABOUT [gryBg1] * CPUs * Motherboards * SSD/HDD * GPUs * Mobile * Enterprise & IT * Smartphones * Memory * Cases/Cooling/PSU(s) * Displays * Mac * Systems * Cloud * Trade Shows * Guides [gryBg1] [icon-faceb]Facebook [icon-twitt]Twitter [icon-rss2]RSS [gryBg1] About Advertising Privacy Policy Contact Us Terms of Use Show Full Site Copyright (c) 2023. All rights reserved. BENCH * [bench_li_p]CPU * [bench_li_p]SSD * [gpubench20]GPU 2013 * [bench_li_p]GPU 2012 * [bench_li_p]Smartphone 2011 * [bench_li_p]Mobile TOPICS * CPUs * Motherboards * SSD/HDD * GPUs * Mobile * Enterprise & IT * Smartphones * Memory * Cases/Cooling/PSU(s) * Displays * Mac * Systems * Cloud * Trade Shows * Guides FOLLOW [icon-faceb]Facebook [icon-twitt]Twitter [icon-rss2]RSS ABOUT * About * Advertising * Privacy Policy * Contact Us * Show Full Site * Copyright (c) 2023. All rights reserved. Log in Don't have an account? Sign up now Username [ ] Password [ ] Remember Me [ ] [LOG IN][ajax-loade] Lost your password? We've updated our terms. By continuing to use the site and/or by logging into your account, you agree to the Site's updated Terms of Use and Privacy Policy.