[HN Gopher] AI Device Template Featuring Whisper, TTS, Groq, Lla...
       ___________________________________________________________________
        
       AI Device Template Featuring Whisper, TTS, Groq, Llama3, OpenAI
        
       Author : indigodaddy
       Score  : 10 points
       Date   : 2024-05-27 17:25 UTC (5 hours ago)
        
 (HTM) web link (github.com)
 (TXT) w3m dump (github.com)
        
       | owenpalmer wrote:
       | The best AI device is your phone or laptop. I simply don't
       | understand the reason for a dedicated device.
        
         | croes wrote:
         | Maybe to prevent access to data you don't want to give to an
         | AI.
        
       | sebastiennight wrote:
       | I'm seeing all of these "AI in a box" experimental products, and
       | none of them are "in a box".
       | 
       | The AI is always server-side. So the device is useless.
       | 
       | Whenever someone figures out how to package the GPU (or LPU, TPU,
       | *PU) into a wearable or portable "box", that device will finally
       | make sense.
       | 
       | ... and it will most likely just be a smartphone.
        
         | beefnugs wrote:
         | Yes, perhaps the biggest ai tragedy is that it makes everyone
         | think they can jump to "throw data into the cloud! ship it
         | boys!" instead of actually designing a real working system.
         | 
         | So for something like this: It has to start with minimal
         | hardware for voice recording, some local small computer just
         | capable enough for simplest local NLP processing. A common open
         | protocol for mesh communication and other local offline
         | hardware to hardware features. Then it should decide when its
         | necessary to reach out and communicate one to one, or one to a
         | group, or send the command up to AI cloud processing because
         | the lower layers cant do whats being asked.
        
       ___________________________________________________________________
       (page generated 2024-05-27 23:02 UTC)