[HN Gopher] Connor Leahy on EleutherAI, Replicating GPT-2/GPT-3,...
       ___________________________________________________________________
        
       Connor Leahy on EleutherAI, Replicating GPT-2/GPT-3, AI Risk and
       Alignment
        
       Author : antman
       Score  : 42 points
       Date   : 2022-02-06 18:59 UTC (4 hours ago)
        
 (HTM) web link (thegradientpub.substack.com)
 (TXT) w3m dump (thegradientpub.substack.com)
        
       | greatpostman wrote:
       | Seems like a pretty good way to get rich:
       | 
       | 1. Raise money to train huge model, or just use 100k or so to
       | train it without raising vc
       | 
       | 2. Train said model, no innovation required
       | 
       | 3. Pump up the PR about releasing "worlds biggest model"
       | 
       | 4. Profit
       | 
       | If anyone wants to do this with me, I'm down
        
         | andreyk wrote:
         | If you actually listen to this or just know what EleutherAI is
         | (A grassroots collective of researchers working to open source
         | AI research), it's very evident that this is not their goal at
         | all
        
         | upwardbound wrote:
         | Aren't Eleuther's models libre and free though?
         | 
         | https://www.eleuther.ai/faq/
         | 
         | > Are the codebases free software?
         | 
         | GPT-Neo is MIT-licensed, while GPT-NeoX is licensed under
         | Apache 2.0. These are the most freely-termed licenses that we
         | can provide for each codebase respectively.
         | 
         | Mesh Transformer JAX is licenced under Apache 2.0.
         | 
         | > Are the models free software?
         | 
         | EleutherAI is licensing models under Apache 2.0. If you use our
         | models, we would highly appreciate you citing or displaying
         | your usage of them.
        
       | mrfusion wrote:
       | If this is open source is there a good way to get involved?
        
         | andreyk wrote:
         | You can hop on their discord looks like
         | 
         | https://www.eleuther.ai/faq/
        
       | sillysaurusx wrote:
       | It was interesting to start the TPU Podcast discord server. I was
       | annoyed Connor showed up and convinced the talented researchers
       | to spend their time on his server. But now I get to claim
       | correctly that Eleuther never would have started without me, so
       | I'll put that up on the trophy shelf. Which happens to be next to
       | Shockley's trophy shelf, across the hall from MySpace.
       | 
       | It was a wild and fun ride. I ended up becoming a published,
       | cited researcher thanks to Eleuther.
       | https://twitter.com/theshawwn/status/1480479272078913539?s=2...
       | 
       | I've always wanted to do a postmortem writeup of my attempt at
       | starting an open source AI lab. It was always my goal from the
       | very moment I pressed the "create server" button, and it's at
       | least mildly interesting that it was successful -- in spite of my
       | efforts, not because of my efforts.
       | 
       | I do feel a pang of jealousy every time I see an article like
       | this, and it would be nice if they'd occasionally link to our
       | server (https://discord.com/invite/x52Xz3y) rather than
       | mentioning it, but (with effort) I managed to transmute those
       | feelings into amusement. It would have been better if I felt
       | amused from day one.
        
       | andreyk wrote:
       | I'd recommend reading the blog post about their first year, it's
       | really fun and informative
       | 
       | https://blog.eleuther.ai/year-one/
        
       ___________________________________________________________________
       (page generated 2022-02-06 23:00 UTC)