[HN Gopher] Nvidia GPU on bare metal NixOS Kubernetes cluster ex...
       ___________________________________________________________________
        
       Nvidia GPU on bare metal NixOS Kubernetes cluster explained
        
       Author : fangpenlin
       Score  : 10 points
       Date   : 2025-03-02 20:26 UTC (2 hours ago)
        
 (HTM) web link (fangpenlin.com)
 (TXT) w3m dump (fangpenlin.com)
        
       | colordrops wrote:
       | This looks fun. The author mentions machine learning workloads.
       | What are typical machine learning use cases for a cluster of
       | lower end GPUs?
       | 
       | While on that topic, why must large model inferencing be done on
       | a single large GPU and/or bank of memory rather than a cluster of
       | them? Is there promise of being able to eventually run large
       | models on clusters of weaker GPUs?
        
       ___________________________________________________________________
       (page generated 2025-03-02 23:00 UTC)