[HN Gopher] Latest GPT-4 training data updated to December 2023
___________________________________________________________________
Latest GPT-4 training data updated to December 2023
Author : Jimmc414
Score : 66 points
Date : 2024-02-19 18:40 UTC (4 hours ago)
(HTM) web link (platform.openai.com)
(TXT) w3m dump (platform.openai.com)
| nephyrin wrote:
| gpt-4-0125-preview has been out for about a month now
| SushiHippie wrote:
| The knowledge cutoff seems to be new, at least in the docs.
|
| See this 25 day old screenshot of the docs which says knowledge
| cutoff April 2023 for the 0125 model
|
| https://www.reddit.com/r/ChatGPT/comments/19fhb6h/new_gpt_4_...
|
| This help article which was updated "this week" also still
| mentions April 2023
|
| https://help.openai.com/en/articles/8555510-gpt-4-turbo-in-t...
|
| And in the announcement for 0125 they didn't say anything about
| the knowledge cutoff change
|
| https://openai.com/blog/new-embedding-models-and-api-updates
| wrs wrote:
| So the version number is continuing as MMDD even though it's a
| new year? That's...confusing.
| AndyNemmity wrote:
| Which version is the chat? It used to show it, but I no longer
| see it
| Urgo wrote:
| You can still ask it:
|
| > when were you last updated?
|
| My last update was in April 2023.
| delgaudm wrote:
| How would we know its telling the truth?
| swyx wrote:
| it is explicitly given that in the system prompt
| https://github.com/spdustin/ChatGPT-
| AutoExpert/blob/835baae7...
| delgaudm wrote:
| So, its Apr 2023 and not Dec 2023?
| ludwik wrote:
| Usually they roll updates over several days, so most
| likely it's currently different for different people.
| behnamoh wrote:
| In my experience, these updates don't matter that much. For
| example, GPT-4 still uses Pydantic v1 syntax (which for the most
| part is deprecated) even though Pydantic v2 came in June 2023.
| the information regarding v1 is so much more in GPT-4's training
| data that "on average" it picks that instead of the new v2 syntax
| data.
|
| This has been a major pain point for me, because GPT-4 constantly
| uses @validator, "const", "always", etc. features that don't work
| on v2.
| Der_Einzige wrote:
| This is why with future models and their effectively unlimited
| context size you'll simply concatenate the entire API codebase
| you're using into the context of your prompt.
| influx wrote:
| I've done similar already, but ChatGPT still tends to rewrite
| the code to the old API, even if it's correctly using the new
| API. Ironically, I just had this happen to me while using
| ChatGPT 4 to use the OpenAI API.
| vitorsr wrote:
| As far as I can tell, pricing per token is not going away
| anytime soon.
| SushiHippie wrote:
| GPT-4 knowledge cutoff is september 2021. GPT-4-Turbo knowledge
| cutoff was April 2023.
|
| Both models were not able to have any pydantic v2 training
| data.
| swyx wrote:
| have you tried adding a clause that all output must come in
| pydantic v2 in your prompt? additionally you can add a few
| common fewshot examples to get it in the pydantic v2 state
| behnamoh wrote:
| I tried exporting the Pydantic documentation page on syntax
| changes as PDF, feeding that to GPT-4, and then telling it to
| be careful about Pydantic syntax changes. That helped it use
| the new syntax, but we can't feed in the entire Pydantic doc
| so it still didn't get the details right.
| fatkam wrote:
| In my experience, updates decrease quality because of ever
| increasing censorship. Improvements are negated really quickly.
| LispSporks22 wrote:
| Can this thing be updated real time?
| PeterisP wrote:
| Probably not right now, the standard process would involve re-
| running a 'finetuning' part after any update to the underlying
| model, and while that's far less expensive than the main
| training, it's probably not something you'd want to do every
| day.
| ryanSrich wrote:
| Not entirely related to just GPT-4, but I feel like not many
| updates will matter for ChatGPT until they completely overhaul
| the system prompt. This seems to be the reason why ChatGPT has
| gotten "dumber".
| https://twitter.com/AlphaSignalAI/status/1757466498287722783
| kjkjadksj wrote:
| How are they filtering out posts from existing generative ai
| models in the training set? Or do they just not bother and train
| on increasingly polluted datasets?
___________________________________________________________________
(page generated 2024-02-19 23:01 UTC)