https://www.servethehome.com/the-nvidia-dgx-spark-is-a-tiny-128gb-ai-mini-pc-made-for-scale-out-clustering-arm/ Refresh (1231 sec) Facebook Instagram Linkedin RSS TikTok Twitter Youtube * Forums * AI * Server + Server Systems + Server CPUs + Accelerators + Server Motherboards + Server Chassis + Other Components * 5G Edge * Storage * Networking * Workstation + Workstation Processors + Workstation Motherboards * Software + Operating Systems + Server Applications + Virtualization * Guides + Buyer's Guides + Tips + Top Hardware Components for TrueNAS / FreeNAS NAS Servers + Top Hardware Components for pfSense Appliances + Top Hardware Components for napp-it and Solarish NAS Servers + Top Picks for Windows Server 2016 Essentials Hardware + The DIY WordPress Hosting Server Hardware Guide Search [ ] Facebook Instagram Linkedin RSS TikTok Twitter Youtube Tuesday, April 1, 2025 * News * Storage Reliability + Raid Calculator + RAID Reliability Calculator | Simple MTTDL Model * Contact * About + Editorial and Copyright Policies * AG Substack * AG Reports * Subscribe * Forums Sign in Welcome! Log into your account [ ]your username [ ]your password [Login] Forgot your password? Get help Privacy Policy Password recovery Recover your password [ ]your email [Send My Password] A password will be e-mailed to you. [STH-Logo-96px] ServeTheHome Advertisement [INS::INS] [STH-Logo-48px] [STH-Logo-96px] * Forums * AI * Server + Server Systems + Server CPUs + Accelerators + Server Motherboards + Server Chassis + Other Components * 5G Edge * Storage * Networking * Workstation + Workstation Processors + Workstation Motherboards * Software + Operating Systems + Server Applications + Virtualization * Guides + Buyer's Guides + Tips + Top Hardware Components for TrueNAS / FreeNAS NAS Servers + Top Hardware Components for pfSense Appliances + Top Hardware Components for napp-it and Solarish NAS Servers + Top Picks for Windows Server 2016 Essentials Hardware + The DIY WordPress Hosting Server Hardware Guide [ ][Search] Home AI The NVIDIA DGX Spark is a Tiny 128GB AI Mini PC Made... * AI * Workstation The NVIDIA DGX Spark is a Tiny 128GB AI Mini PC Made for Scale-Out Clustering By Patrick Kennedy - March 20, 2025 8 Facebook Twitter Pinterest Linkedin Email Print Copy URL NVIDIA DGX Spark 2 Node Cluster Front Angle 2NVIDIA DGX Spark 2 Node Cluster Front Angle 2 With 20 Arm cores connected using C2C to a Blackwell generation GPU, 128GB of LPDDR5X memory, and 200GbE NVIDIA ConnectX-7 networking, the NVIDIA DGX Spark is exciting. At $3999 it is far from cheap. On the other hand, we expect folks to create the most awesome clusters with this. The NVIDIA DGX Spark is a Tiny 128GB AI Mini PC Made for Scale-Out Clustering The NVIDIA DGX Spark is tiny, easily fitting into the palm of your hand, with flashy styling reminiscent of the NVIDIA DGX-1. What is inside is going to be a game-changer for those serious about local and portable AI development. Instead of a large, power-hungry rack server, this is a 170W device. NVIDIA DGX Spark Front Angle 1NVIDIA DGX Spark Front Angle 1 Inside, Arm-based CPU offers 10 Cortex-X925 and 10 Cortex-A725 Arm cores for 20 cores total. Unlike the GB300 data center GPU, the GB10 has display outputs. The package is flanked by 128GB of LPDDR5X shared memory (rated at 273GB/s.) NVIDIA GB10 Motherboard Angle 1NVIDIA GB10 Motherboard Angle 1 NVIDIA and Mediatek worked on the GB10. Inside, the NVIDIA GB10 combes both an Arm CPU and a NVIDIA Blackwell GPU into a single packaged linked by NVIDIA's C2C interconnect. You can see the two die package in a close-up. NVIDIA GB10 Close 1NVIDIA GB10 Close 1 Speaking of two, NVIDIA is selling and supporting these not just as single AI mini computers. Instead, having two in a cluster will be a sold and supported configuration. NVIDIA DGX Spark 2 Node Cluster Front Angle 3NVIDIA DGX Spark 2 Node Cluster Front Angle 3 On the back we have four USB4 40Gbps ports, a HDMI port, a 10GbE port, and then the dual port NVIDIA ConnectX-7 NIC that we were told supports 200GbE clustering with a second unit. NVIDIA DGX Spark 2 Node Cluster Front Angle 1NVIDIA DGX Spark 2 Node Cluster Front Angle 1 Indeed, on the pre-order page, the NVIDIA DGX Spark 4TB is listed at $3999, or $1000 more than the ASUS Ascent GX10 that shares the same motherboard but with only 1TB of local storage. There is also an option for a NVIDIA DGX Spark Bundle with two of these units and a QSFP cable to support the clustering. NVIDIA DGX Spark Cluster Pre-Order PricingNVIDIA DGX Spark Cluster Pre-Order Pricing We asked about the ability to connect more than two. NVIDIA said that initially they were focused on bringing 2x GB10 cluster configurations out using the 200GbE RDMA networking. There is also nothing really stopping folks from scaling out other than that is not an initially suppored NVIDIA configuration. NVIDIA will ship these with the NVIDIA DGX OS as like what comes on DGX systems. That is an Ubuntu Linux base with many of the NVIDIA drivers and goodies baked in so you will be able to use things like NCCL to scale-out out of the box. Final Words In a package coming in at just over 1.1L and 1.2kg, it is hard not to be excited about one of these. What is more, it is even harder not to be excited about clustering these small systems. The addition of real high-speed networking means that there is easy potential for using a number of these with network storage, perhaps making the 1TB versions a better value. NVIDIA DGX Spark 2 Node Cluster Front Angle 2NVIDIA DGX Spark 2 Node Cluster Front Angle 2 Somewhat surprisingly, even with NVIDIA showing off huge systems, this might be one of my favorite product announcements of the entire show, especially since NVIDIA is showing off and taking pre-order reservations for the clustered versions. Apple may have better memory bandwidth on the M3 Ultra, but this is another league of scale-out networking from a 10GbE or direct Thunderbolt network. Just the ability to scale to two in a cluster with a single cable makes these very interesting, and the big question is whether NVIDIA will try to scale these out even bigger (or if users will beat them to it and do it on their own.) We are hoping to see these ship this summer. [INS::INS] * TAGS * 200GbE * ARM * ConnectX-7 * DGX * GB10 * NVIDIA Facebook Twitter Pinterest Linkedin Email Print Copy URL Previous articleThis is the ASUS Ascent GX10 a NVIDIA GB10 Mini PC with 128GB of Memory and 200GbE Next articleSamsung 9100 PRO 2TB PCIe Gen5 NVMe SSD Review Patrick Kennedy https://www.servethehome.com Patrick has been running STH since 2009 and covers a wide variety of SME, SMB, and SOHO IT topics. Patrick is a consultant in the technology industry and has worked with numerous large hardware and storage vendors in the Silicon Valley. The goal of STH is simply to help users find some information about server, storage and networking, building blocks. If you have any helpful information please feel free to post on the forums. Facebook Linkedin Twitter RELATED ARTICLESMORE FROM AUTHOR Dell Precision 3280 Compact Front Label Dell Precision 3280 Compact Review A Neat Compact Workstation Crucial CT64G56C46S5 DDR5 5600 SODIMM Front 1 The Crucial 128GB DDR5-5600 SODIMM Kit We Are Using in Mini PCs NVIDIA Kyber Rubin NVL576 Midplane 2 The NVIDIA Rubin NVL576 Kyber Midplane is Huge 8 COMMENTS 1. Y0s March 20, 2025 At 1:59 pm How are these powered? There's no info on the NVIDIA page. The pictures of the ASUS version show one USB power port. How much power do they consume? 2. red March 20, 2025 At 2:13 pm @Y0s - lack of detail from an NVIDIA web page? color me shocked 3. MDF March 20, 2025 At 3:12 pm @Y0s I see no power port myself, but it's 170W ...so I'm thinking this is USB powered. Laptop USB power ports are now up over 200W so I'm thinking that's what is going on. 4. Patrick Kennedy March 20, 2025 At 8:01 pm This is correct. USB Type-C power input. I think it makes a bit more sense with the ASUS labeling. 5. Yacoub Alkilani March 20, 2025 At 8:40 pm There's a small nuclear fusion power resctor inside powering this wonderful device Just kidding Great stuff Thanks Patrick 6. who March 20, 2025 At 11:09 pm I want to see a comparison between this and a similarly priced M3 Ultra studio. I heard this can run a 200b model, but I've also heard this was going to be $1,000 less, while the M3 Ultra specced out can run a 600b model, or something to that effect. 7. David Vincent March 21, 2025 At 6:13 pm looks like this summer will be summer of clusters with the mac studio already out and these devices on the way! 8. splifingate March 24, 2025 At 12:55 am ok, I Reserved a DGX Bundle . . . this should be interesting :) LEAVE A REPLY [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] Please enter your comment! [ ] Please enter your name here [ ] You have entered an incorrect email address! Please enter your email address here [ ] [ ]Save my name, email, and website in this browser for the next time I comment. [ ]Sign me up for the STH newsletter! [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] D[ ] This site uses Akismet to reduce spam. Learn how your comment data is processed. Newsletter Get the best of STH delivered weekly to your inbox. We are going to curate a selection of the best posts from STH each week and deliver them directly to you. Your email address: [ ] [Sign up] By opting-in you agree to have us send you our newsletter. We are using a third party service to manage subscriptions so you can unsubscribe at any time. Leave this field empty if you're human: [ ] [STH-Logo-96px] ABOUT US ServeTheHome is the IT professional's guide to servers, storage, networking, and high-end workstation hardware, plus great open source projects. Advertise on STH DISCLAIMERS: We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites. Please be advised of our data usage for machine learning and AI inference and training purposes which can be found here along with our other editorial and copyright policies. FOLLOW US Facebook Instagram Linkedin RSS TikTok Twitter Youtube (c) 2009-2025 Axautik Group LLC Refresh (1231 sec)