[HN Gopher] Clip: Connecting Text and Images
       ___________________________________________________________________
        
       Clip: Connecting Text and Images
        
       Author : sama
       Score  : 47 points
       Date   : 2021-01-05 19:19 UTC (3 hours ago)
        
 (HTM) web link (openai.com)
 (TXT) w3m dump (openai.com)
        
       | gravy wrote:
       | Sometimes I look at stuff like this and sit in despair that I'm
       | not learning anything that will let me work these kinds of
       | problems while I work at a defense contractor maintaining 20+
       | year old code.
        
         | panabee wrote:
         | you can catch up very quickly.
         | 
         | great resource on transformers, which underpin the openai
         | breakthroughs (the "T" in GPT-3 stands for transformer):
         | http://peterbloem.nl/blog/transformers
         | 
         | great reddit sub for tracking ml research and trends:
         | https://www.reddit.com/r/machinelearning
         | 
         | great email newsletter on ml from andrew ng:
         | https://www.deeplearning.ai/thebatch/
         | 
         | also, someone must maintain old code or things break. thanks
         | for your contributions.
        
         | modeless wrote:
         | The field is young and unlike mature fields such as physics or
         | mathematics it doesn't take a lifetime of study to master, yet.
         | Neural nets are actually pretty simple at their core; seemingly
         | too simple to work as well as they do.
         | 
         | It's entirely possible to learn this stuff to near state-of-
         | the-art level with a year or two of self-directed study outside
         | of work. All the research is published open access, the
         | software is open source, there are many high quality datasets
         | available, hardware access is simple and free through Colab,
         | and there are dozens of online courses and lectures at every
         | level from beginner all the way to the cutting edge, again all
         | free.
        
         | android2222 wrote:
         | Haha you are not alone as I do the same on an old CRM for non-
         | profits. I'm thinking about going back to school to gain the
         | missing math and science I need to get myself to a more
         | challenging job. Boring business software just ain't fun. But
         | it pays :)
        
       | neosat wrote:
       | Impressive work! Their approach makes a ton of sense: "by not
       | directly optimizing for the benchmark, we show that it becomes
       | much more representative"
       | 
       | and is evident in the generalization and robustness: ~74% higher
       | on the adversarial benchmark and similar/superior results on the
       | standard Imagenet
        
       | kordlessagain wrote:
       | Now if there were just a model that would clip images out of a
       | page for me.
        
       ___________________________________________________________________
       (page generated 2021-01-05 23:00 UTC)