[HN Gopher] Nvidia L40S Is the Nvidia H100 AI Alternative with a...
       ___________________________________________________________________
        
       Nvidia L40S Is the Nvidia H100 AI Alternative with a Big Benefit
        
       Author : PaulHoule
       Score  : 19 points
       Date   : 2023-11-06 19:16 UTC (1 hours ago)
        
 (HTM) web link (www.servethehome.com)
 (TXT) w3m dump (www.servethehome.com)
        
       | modeless wrote:
       | Did I miss it or did they not say how much it costs?
        
         | mnholt wrote:
         | $12k each at Thinkmate
        
       | omneity wrote:
       | I don't know about the L40S but my experience with the L40 hasn't
       | been so good. I would say it's okay-ish to decent for inference.
       | Horribly slower than a H100 or even a A100 for training.
       | 
       | The FP8 and higher cuda level is nice I guess, if your toolchain
       | supports it.
        
       ___________________________________________________________________
       (page generated 2023-11-06 21:00 UTC)