[HN Gopher] A guide to open-source LLM inference and performance
       ___________________________________________________________________
        
       A guide to open-source LLM inference and performance
        
       Author : varunshenoy
       Score  : 46 points
       Date   : 2023-11-20 20:33 UTC (2 hours ago)
        
 (HTM) web link (www.baseten.co)
 (TXT) w3m dump (www.baseten.co)
        
       | samspenc wrote:
       | Likely trending on home page since this is directly relevant to
       | LLM costs, i.e., questions like "how much would it cost to
       | rebuild ChatGPT from scratch".
        
         | simsspoons wrote:
         | highly relevant question today
        
       | seth_ wrote:
       | love the deep dive here
        
       ___________________________________________________________________
       (page generated 2023-11-20 23:00 UTC)