[HN Gopher] AI / ML / LLM / Transformer Models Timeline
       ___________________________________________________________________
        
       AI / ML / LLM / Transformer Models Timeline
        
       Author : vemgar
       Score  : 48 points
       Date   : 2023-04-30 19:52 UTC (3 hours ago)
        
 (HTM) web link (ai.v-gar.de)
 (TXT) w3m dump (ai.v-gar.de)
        
       | visarga wrote:
       | It's a summary of the most famous models, not exhaustive by any
       | means.
        
       | mysterypie wrote:
       | I keep hearing that there have been significant breakthroughs in
       | the areas of AI / ML / LLM / Transformer Models between 2012 and
       | present. Can summarize what the breakthroughs were, who was
       | principally responsible, and which papers specifically?
       | 
       | This timeline has something like 60 papers and many papers have
       | 8-30 authors. Are the breakthroughs spread out like that? Or are
       | there one or two super important works? Sort of like Einstein's
       | "On the Electrodynamics of Moving Bodies"?
        
         | nighthawk454 wrote:
         | The graph helps clarify that. Look at the ones that are
         | heavily-connected ancestors.
        
         | Garcia98 wrote:
         | The most notable paper is probably the one that defined the
         | concept of transformers, Attention Is All You Need:
         | https://arxiv.org/abs/1706.03762
        
       | esafak wrote:
       | This is fine for historians, if any are studying this. What
       | practitioners need is help in picking a model. For a given task,
       | what are the best models, and what are their trade-offs?
       | 
       | If there were a database of model benchmarks, type of task
       | represented by the benchmark, dataset used, and other salient
       | features like number of parameters, etc. life would be easier.
       | 
       | If none exists, and one were motivated to create one, what's the
       | best place to crowdsource a relational database?
        
         | whimsicalism wrote:
         | paperswithcode
        
           | esafak wrote:
           | TIL that site does more than share code! Here are relevant
           | entries for this post:
           | 
           | https://paperswithcode.com/methods/category/transformers
           | 
           | https://paperswithcode.com/paper/harnessing-the-power-of-
           | llm...
        
       | TuringNYC wrote:
       | Love this! What system did you use to produce this? Was it
       | custom-built or are you using a system to take dependencies+dates
       | and plot all this out?
        
         | vemgar wrote:
         | This one is custom-built in Python. It generates Graphviz DOT
         | files which will be rendered into SVG. The rest is a simple
         | static site generator.
        
       ___________________________________________________________________
       (page generated 2023-04-30 23:00 UTC)