[HN Gopher] Show HN: AI companions stack - create and host your ...
       ___________________________________________________________________
        
       Show HN: AI companions stack - create and host your own AI
       companions
        
       Author : ykhli
       Score  : 24 points
       Date   : 2023-07-12 18:45 UTC (4 hours ago)
        
 (HTM) web link (github.com)
 (TXT) w3m dump (github.com)
        
       | mcbuilder wrote:
       | I hosted my own AI using SillyTavern + text-generation backend
       | (e.g. oogabooga / KoboldAI), just need the power needed to crank
       | the LLM.
        
       | yonixw wrote:
       | It's not host your own AI at all! You need like 5 saas api-keys
       | to operate this app. But sure, you can host this UI on your own.
        
         | causality0 wrote:
         | It makes me wonder how long it will be until open-source
         | locally-run AI chatbots reach the GPT-4 level. Five years? Ten?
        
           | swyx wrote:
           | its more a question of hardware progress than software
           | probably. theres a minimum level for these behaviors to
           | emerge
        
           | lettergram wrote:
           | It depends on the tasks, I'd argue some of the open source
           | alternatives are at the gpt-4 level already, particularly for
           | code generation.
           | 
           | That said, I suspect summarization, translation, etc will
           | take time. I'd suspect under 1 year.
        
             | worldsayshi wrote:
             | >I'd argue some of the open source alternatives are at the
             | gpt-4 level already, particularly for code generation.
             | 
             | Like which one?
        
       | Havoc wrote:
       | Is this a16z associate with the vc a16z?
        
         | dmarcos wrote:
         | Yeah.
         | https://twitter.com/stuffyokodraws/status/167879943947197235...
         | 
         | Smart. A VC firm that heavily invests in software platforms
         | will make much better decisions if they have first hand
         | experience using the products.
        
           | rand1239 wrote:
           | Or if the fed prints a lot of money or makes interest rates
           | 0. Which is what the A16Z playbook is atleast.
        
       | rand1239 wrote:
       | [flagged]
        
       | arisAlexis wrote:
       | I don't get why I wouldn't just keep an open tab with chatgpt on
       | specific topics. They will very soon have big enough context
       | windows. Why build another UI, deployment pipes and all that jazz
       | ?
       | 
       | P.s nobody will *sms the companion
        
         | rootusrootus wrote:
         | For me, it would be cost and alignment. If I own the software,
         | I can choose whatever alignment suits me, or none at all. And
         | ChatGPT is $20/month (assuming you want GPT4, and I do).
         | 
         | But there's still a good argument for a hybrid solution. Buy
         | GPT4 access through the API and get a native UI to query it.
         | Much cheaper to pay as you go, and someone else is still
         | handling the heavy lifting. But if you want an uncensored
         | model, you're out of luck.
        
         | babyshake wrote:
         | Its roughly comparable to how you can use a spreadsheet to do a
         | lot of different things, but it improves the UX (with some
         | trade-offs) to have more custom designed UIs instead of
         | directly using a spreadsheet.
        
       ___________________________________________________________________
       (page generated 2023-07-12 23:00 UTC)