[HN Gopher] Show HN: Search inside YouTube videos using natural ...
       ___________________________________________________________________
        
       Show HN: Search inside YouTube videos using natural language
       queries
        
       Author : vladoh
       Score  : 32 points
       Date   : 2021-02-12 21:29 UTC (1 hours ago)
        
 (HTM) web link (github.com)
 (TXT) w3m dump (github.com)
        
       | vladoh wrote:
       | This is a demonstration of the abilities of OpenAI's CLIP neural
       | network. The tool will download a YouTube video, extract frames
       | at regular intervals and precompute the feature vectors of each
       | frame using CLIP.
       | 
       | You can then use natural language search queries to find a
       | particular frame of the video. The results are really amazing in
       | my opinion...
       | 
       | If you want to experiment with it yourself, I prepared a Colab
       | notebook that can easily be run:
       | https://colab.research.google.com/github/haltakov/natural-la...
        
         | pininja wrote:
         | This is very cool! Does this produce a occurrence index by any
         | chance? It would be neat to explore a word map of a video.
        
           | vladoh wrote:
           | Not yet, but I had this idea as well. You basically get a
           | score describing how well a phrase is matching each of the
           | images so it won't be difficult to do. I'll look into that!
        
       | purplecats wrote:
       | notebook isn't loading for me but this seems really cool
        
         | vladoh wrote:
         | Hmm, this is strange... The Colab notebook should load even if
         | you are not logged in with your Google account (you will need
         | to log in if you want to run it, though).
        
       ___________________________________________________________________
       (page generated 2021-02-12 23:00 UTC)