[HN Gopher] A 30B Qwen Model Walks into a Raspberry Pi and Runs ...
       ___________________________________________________________________
        
       A 30B Qwen Model Walks into a Raspberry Pi and Runs in Real Time
        
       Author : dataminer
       Score  : 25 points
       Date   : 2026-01-06 20:55 UTC (2 hours ago)
        
 (HTM) web link (byteshape.com)
 (TXT) w3m dump (byteshape.com)
        
       | yjftsjthsd-h wrote:
       | In case anyone else clicked in wondering what counts as "real
       | time" for this:
       | 
       | > On a Pi 5 (16GB), Q3_K_S-2.70bpw [KQ-2] hits 8.03 TPS at 2.70
       | BPW and maintains 94.18% of BF16 quality.
       | 
       | And they talk about other hardware and details. But that's the
       | expanded version of the headline claim.
        
         | CSSer wrote:
         | Someone should make a version of the Hacker News homepage that
         | is just LLM extracts of key article details like this.
        
           | mschuster91 wrote:
           | Please not. There were some bots (or karma-farming users)
           | doing this and yuck, was it annoying.
        
       ___________________________________________________________________
       (page generated 2026-01-06 23:02 UTC)