https://www.techradar.com/pro/google-is-rapidly-turning-into-a-formidable-opponent-to-bff-nvidia-the-tpu-v5p-ai-chip-powering-its-hypercomputer-is-faster-and-has-more-memory-and-bandwidth-than-ever-before-beating-even-the-mighty-h100 Skip to main content * * (*) ( ) Open menu Close menu TechRadar the business technology experts [ ] Search Search TechRadar [ ] RSS US Edition flag of US (English) Asia flag of Singapore Singapore Europe flag of Danmark Danmark flag of Suomi Suomi flag of Norge Norge flag of Sverige Sverige flag of UK UK flag of Italia Italia flag of Nederland Nederland flag of Belgie (Nederlands) Belgie (Nederlands) flag of France France flag of Deutschland Deutschland flag of Espana Espana North America flag of US (English) US (English) flag of Canada Canada flag of Mexico Mexico Australasia flag of Australia Australia flag of New Zealand New Zealand * * News * Reviews * Features * Expert Insights * Website builders * Web hosting * Security Trending * Expert Insights * Best web hosting * Best website builder * Best standing desks When you purchase through links on our site, we may earn an affiliate commission. Here's how it works. 1. Pro Google is rapidly turning into a formidable opponent to BFF Nvidia -- the TPU v5p AI chip powering its hypercomputer is faster and has more memory and bandwidth than ever before, beating even the mighty H100 News By Keumars Afifi-Sabet published 23 December 2023 Google's latest AI chip is up to 2.8 times faster at training LLMs than its predecessor, and is fitted into the AI Hypercomputing architecture * * * * * * Racks of servers inside a data center. (Image credit: Future) Google accompanied the recent launch of its Gemini AI models with the latest version of its flagship tensor processing unit (TPU) for AI training and inference, in what appears to be an attempt to take on Nvidia's own market-leading GPUs. TPU v5p - Google's most powerful custom-designed AI accelerator - has been deployed to power the firm's 'AI Hypercomputer'. This is a supercomputing architecture that's built specifically to run AI applications, rather than supercomputers which normally run scientific workloads, because TPUs are unsuited to this. The latest version of its TPU has 8,960 chips per pod (which comprise the system), versus 4,096 in v4, and it's four times as scalable in terms of total availability of FLOPs per pod. These new pods provide a throughput of 4,800Gbps. The new pods also have 95GB of high-bandwidth memory (HBM) versus 32GB HBM RAM in TPU v4. Nvidia H100 vs Google TPU v5p: Which is faster? Unlike Nvidia, which offers its GPUs out for other companies to purchase, Google's custom-made TPUs remain in-house for use across its own products and services. Google's TPUs have long been used to power its services including Gmail, YouTube and Android, and the latest version has also been used to train Gemini. Google's v5p TPUs are up to 2.8 times faster at training large language models than TPU v4, and offer 2.1-times value-for-money. Although the intermediary version, TPU v5e, released earlier this year, offers the most value for money of all three, it's only up to 1.9-times faster than TPU v4, making TPU v5p the most powerful. It's even powerful enough to rival Nvidia's widely in-demand H100 GPU, which is one of the best graphics cards out there for AI workloads. This component is four times faster at training workloads than Nvidia's A100 GPU, according to the company's own data. Google's TPU v4, meanwhile, is estimated to be between 1.2 and 1.7-times faster than the A100, according to research it published in April. Incredibly rough calculations would suggest the TPU v5p, therefore, is roughly between 3.4 and 4.8-times faster than the A100 - which makes it on par or superior to the H100, although more detailed benchmarking is needed before any conclusions can be drawn. More from TechRadar Pro * What is Google Gemini? Everything you need to know about Google's next-gen AI * These are the best graphics cards out there that you can buy * AMD vs Nvidia: who is the graphics card champion? Are you a pro? Subscribe to our newsletter Sign up to the TechRadar Pro newsletter to get all the top news, opinion, features and guidance your business needs to succeed! [ ][ ]Contact me with news and offers from other Future brands[ ]Receive email from us on behalf of our trusted partners or sponsors[Sign me up] By submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over. Keumars Afifi-Sabet Keumars Afifi-Sabet Social Links Navigation Channel Editor (Technology), Live Science Keumars Afifi-Sabet is the Technology Editor for Live Science. He has written for a variety of publications including ITPro, The Week Digital and ComputerActive. He has worked as a technology journalist for more than five years, having previously held the role of features editor with ITPro. In his previous role, he oversaw the commissioning and publishing of long form in areas including AI, cyber security, cloud computing and digital transformation. More about pro Ransomware attack on a computer This devious malware uses Bond-inspired driver to kill security suites -- then proceeds to systematically encrypt your data and drops a $2 million ransom request ebay logo Over a thousand jobs are going at eBay as ecommerce giant admits it grew too fast Latest Mac Mini (M2) (2023) deals image This M2 Mac mini deal has me double-checking the calendar to make sure it's not Black Friday See more latest > TOPICS Nvidia Google Most Popular [missing-im]How businesses can adapt to consumers' changing digital needs By Duncan RobertsJanuary 24, 2024 [missing-im]The Apple Vision Pro arrives in stores next week, but you can 'see' the AR headset at home now using... AR By Lance UlanoffJanuary 24, 2024 [missing-im]Splatoon 3 Side Order DLC has an official release date By Demi WilliamsJanuary 24, 2024 [missing-im]The growing threat of data breaches in the age of AI and data privacy By Fabien RechJanuary 24, 2024 [missing-im]The new Titan Evo Lite is a budget gaming chair that packs a ton of premium features By Dashiell WoodJanuary 24, 2024 [missing-im]One of world's largest water utility company hit by ransomware attack -- water supplies could be affected, incident seems to have limited impact with no customer data leaks reported By Sead FadilpasicJanuary 24, 2024 [missing-im]The Day Before developer claims a 'hate campaign' towards the game 'inflicted significant damage' By Catherine LewisJanuary 24, 2024 [missing-im]AMD's new graphics driver offers a free frame rate boost for all PC games - with a couple of notable catches By Darren AllanJanuary 24, 2024 [missing-im]15 million Trello users at risk after unknown hacker uses proxy service to scrape data -- emails, usernames, full names and other accounts info are available for sale on hacking forum By Sead FadilpasicJanuary 24, 2024 [missing-im]Google Pixel 8a packaging leak points to a potential design change By James IdeJanuary 24, 2024 [missing-im]This Blackberry-style phone with an E-Ink screen wants to fix your scrolling addiction By Mark WilsonJanuary 24, 2024 TOPICS Nvidia Google MOST POPULARMOST SHARED 1. The Silencing 1 Christmas movies are ruling Netflix's weekly top 10, but two thrillers are crashing the party 2. 2 Over 100 A24 films are headed to Max - here are 5 must-watches to start with 3. 3 Zenless Zone Zero has an official release window 4. 4 Microsoft is changing the way it updates Windows - and it's starting to sound like Windows 12 won't happen 5. 5 Prime Video's Mr and Mrs Smith trailer shows off an exhilarating spinoff series with a twist 1. The Silencing 1 Christmas movies are ruling Netflix's weekly top 10, but two thrillers are crashing the party 2. 2 The iPhone 15 Pro's telephoto camera will get a big focusing boost soon 3. 3 Prime Video's Mr and Mrs Smith trailer shows off an exhilarating spinoff series with a twist 4. 4 Yamaha just unveiled a 5-disc CD changer like it's 2002 - Secret Santa, take a hint 5. 5 I switched from a 65-inch TV to a 4K projector - and the results surprised me TechRadar is part of Future US Inc, an international media group and leading digital publisher. Visit our corporate site. * About Us * Contact Future's experts * Contact Us * Terms and conditions * Privacy policy * Cookies policy * Advertise with us * Web notifications * Accessibility Statement * Careers (c) Future US, Inc. Full 7th Floor, 130 West 42nd Street, New York, NY 10036.