[HN Gopher] Ollama 0.4 is released with support for Meta's Llama...
       ___________________________________________________________________
        
       Ollama 0.4 is released with support for Meta's Llama 3.2 Vision
       models locally
        
       Author : BUFU
       Score  : 59 points
       Date   : 2024-11-06 21:10 UTC (1 hours ago)
        
 (HTM) web link (ollama.com)
 (TXT) w3m dump (ollama.com)
        
       | Patrick_Devine wrote:
       | This was a pretty heavy lift for us to get out which was why it
       | took a while. In addition to writing new image processing
       | routines, a vision encoder, and doing cross attention, we also
       | ended up re-architecting the way the models get run by the
       | scheduler. We'll have a technical blog post soon about all the
       | stuff that ended up changing.
        
         | exe34 wrote:
         | did you feed back into llama.cpp?
         | 
         | also, can it do grounding like cogvlm?
         | 
         | either way, great job!
        
       | inasring wrote:
       | Can it run the quantized models?
        
       ___________________________________________________________________
       (page generated 2024-11-06 23:01 UTC)