[HN Gopher] Latest GPT-4 training data updated to December 2023
       ___________________________________________________________________
        
       Latest GPT-4 training data updated to December 2023
        
       Author : Jimmc414
       Score  : 66 points
       Date   : 2024-02-19 18:40 UTC (4 hours ago)
        
 (HTM) web link (platform.openai.com)
 (TXT) w3m dump (platform.openai.com)
        
       | nephyrin wrote:
       | gpt-4-0125-preview has been out for about a month now
        
         | SushiHippie wrote:
         | The knowledge cutoff seems to be new, at least in the docs.
         | 
         | See this 25 day old screenshot of the docs which says knowledge
         | cutoff April 2023 for the 0125 model
         | 
         | https://www.reddit.com/r/ChatGPT/comments/19fhb6h/new_gpt_4_...
         | 
         | This help article which was updated "this week" also still
         | mentions April 2023
         | 
         | https://help.openai.com/en/articles/8555510-gpt-4-turbo-in-t...
         | 
         | And in the announcement for 0125 they didn't say anything about
         | the knowledge cutoff change
         | 
         | https://openai.com/blog/new-embedding-models-and-api-updates
        
       | wrs wrote:
       | So the version number is continuing as MMDD even though it's a
       | new year? That's...confusing.
        
       | AndyNemmity wrote:
       | Which version is the chat? It used to show it, but I no longer
       | see it
        
         | Urgo wrote:
         | You can still ask it:
         | 
         | > when were you last updated?
         | 
         | My last update was in April 2023.
        
           | delgaudm wrote:
           | How would we know its telling the truth?
        
             | swyx wrote:
             | it is explicitly given that in the system prompt
             | https://github.com/spdustin/ChatGPT-
             | AutoExpert/blob/835baae7...
        
               | delgaudm wrote:
               | So, its Apr 2023 and not Dec 2023?
        
               | ludwik wrote:
               | Usually they roll updates over several days, so most
               | likely it's currently different for different people.
        
       | behnamoh wrote:
       | In my experience, these updates don't matter that much. For
       | example, GPT-4 still uses Pydantic v1 syntax (which for the most
       | part is deprecated) even though Pydantic v2 came in June 2023.
       | the information regarding v1 is so much more in GPT-4's training
       | data that "on average" it picks that instead of the new v2 syntax
       | data.
       | 
       | This has been a major pain point for me, because GPT-4 constantly
       | uses @validator, "const", "always", etc. features that don't work
       | on v2.
        
         | Der_Einzige wrote:
         | This is why with future models and their effectively unlimited
         | context size you'll simply concatenate the entire API codebase
         | you're using into the context of your prompt.
        
           | influx wrote:
           | I've done similar already, but ChatGPT still tends to rewrite
           | the code to the old API, even if it's correctly using the new
           | API. Ironically, I just had this happen to me while using
           | ChatGPT 4 to use the OpenAI API.
        
           | vitorsr wrote:
           | As far as I can tell, pricing per token is not going away
           | anytime soon.
        
         | SushiHippie wrote:
         | GPT-4 knowledge cutoff is september 2021. GPT-4-Turbo knowledge
         | cutoff was April 2023.
         | 
         | Both models were not able to have any pydantic v2 training
         | data.
        
         | swyx wrote:
         | have you tried adding a clause that all output must come in
         | pydantic v2 in your prompt? additionally you can add a few
         | common fewshot examples to get it in the pydantic v2 state
        
           | behnamoh wrote:
           | I tried exporting the Pydantic documentation page on syntax
           | changes as PDF, feeding that to GPT-4, and then telling it to
           | be careful about Pydantic syntax changes. That helped it use
           | the new syntax, but we can't feed in the entire Pydantic doc
           | so it still didn't get the details right.
        
         | fatkam wrote:
         | In my experience, updates decrease quality because of ever
         | increasing censorship. Improvements are negated really quickly.
        
       | LispSporks22 wrote:
       | Can this thing be updated real time?
        
         | PeterisP wrote:
         | Probably not right now, the standard process would involve re-
         | running a 'finetuning' part after any update to the underlying
         | model, and while that's far less expensive than the main
         | training, it's probably not something you'd want to do every
         | day.
        
       | ryanSrich wrote:
       | Not entirely related to just GPT-4, but I feel like not many
       | updates will matter for ChatGPT until they completely overhaul
       | the system prompt. This seems to be the reason why ChatGPT has
       | gotten "dumber".
       | https://twitter.com/AlphaSignalAI/status/1757466498287722783
        
       | kjkjadksj wrote:
       | How are they filtering out posts from existing generative ai
       | models in the training set? Or do they just not bother and train
       | on increasingly polluted datasets?
        
       ___________________________________________________________________
       (page generated 2024-02-19 23:01 UTC)