[HN Gopher] OpenAI's CEO confirms the company isn't training GPT...
       ___________________________________________________________________
        
       OpenAI's CEO confirms the company isn't training GPT-5 and 'won't
       for some time'
        
       Author : DDSDev
       Score  : 6 points
       Date   : 2023-04-14 21:43 UTC (1 hours ago)
        
 (HTM) web link (www.theverge.com)
 (TXT) w3m dump (www.theverge.com)
        
       | fzliu wrote:
       | OpenAI may not be training GPT-5, but Sam didn't say anything
       | about GPT-4.5.
        
         | thenipper wrote:
         | Maybe they'll pull an MS and go straight to GPT X
        
       | cs702 wrote:
       | Left unsaid in this piece is that OpenAI likely would have to
       | increase parameters and compute by an order of magnitude (~10x)
       | to train a new model that offers noticeable improvements over
       | GPT-4, due to the diminishing returns seen in "transformer
       | scaling laws."
       | 
       | Also, it's possible that OpenAI is _still_ training GPT-4,
       | perhaps with additional modalities, and will make future
       | snapshots available as public releases.
        
         | version_five wrote:
         | They could clean up the training data I bet. That would be
         | where I'd focus next.
        
         | iliane5 wrote:
         | I bet they're not saying how big of a model GPT-4 is because
         | it's actually much smaller we would expect.
         | 
         | ChatGPT is IMO a heavily fine-tuned Curie sized model (same
         | price via API + less cognitive capacity than even text
         | davinci-003) so it would make sense that a heavily fine-tuned
         | Davinci sized model would yield similar results to GPT-4.
        
       ___________________________________________________________________
       (page generated 2023-04-14 23:01 UTC)