Self Host personal Assistant ? reddit / selfhosted ---------------------------------------------------------------------- tomimsmith · 2023-12-06 19:47 Hi all, curiosity mostly. But has anyone tried or succeeded a self host AI personal assistant similar to alexa/cortana.... Additional with tie ins to home assistant also google home. Looking for a long term project. server resources are not an issue neither is storage. Best place to start ? ---------------------------------------------------------------------- warpapya · 2023-12-07 02:15 I've created some hacky assistants to varying degrees of success. The part that remains tricky is alexa/siri style "wake word, do the thing" interaction. Especially since I've got all homepods in my setup and I'm pretty tied to keeping them. I've gotten around this with things like siri shortcuts that essentially pass the request directly to my assistant instead of siri handling it, but that's cumbersome. [Rhasspy](https://rhasspy.readthedocs.io/en/latest/) seems promising and I started to tinker with it, but didn't get to a functional state before I got distracted by something else. The most successful iteration, in my opinion, was utilizing Siri shortcuts as a voice input method (again, cumbersome, but got the job done). For the response, I used TTS AI to create a unique voice. and then logic and action execution were handled by a LLM based on Mistral, integrated with [Windmill](https://www.windmill.dev/) to carry out any code execution needed. ---------------------------------------------------------------------- ThtRndmEncntrGy · 2023-12-07 03:24 Awesome! Thanks for the hint. I was gonna ask about this myself, because I’ve really wanted to build an AI assistant for handling my server. ---------------------------------------------------------------------- No_Bee_7194 · 2023-12-07 04:00 I tried Lion, but it seems that it has been abandoned. ---------------------------------------------------------------------- chiphavoc · 2023-12-07 05:35 Home assistant with piper, whisper, openwakeword and chat-gpt conversational agent. I’m working on it in my spare time (to run something like this in my self-hosted kubernetes environment). ---------------------------------------------------------------------- l0033z · 2023-12-07 09:08 This is the way. I’ve been able to replace the chatgpt conversational agent with my own Python program which acts as an agent too - using LangChain to interface with LLMs, which could be self hosted too but I haven’t had good results when it comes to making the LLM use tools on locally hosted LLMs (only on GPT4). Is this sort of thing something that people have an interest in? I’ve been working on it for myself and the code is all on github. Just not very organized. It can do stuff like control home assistant devices, check weather, fetch news, etc. Adding new tools isn’t too hard. ---------------------------------------------------------------------- root-node · 2023-12-07 12:52 I have been using Rhasspy for a couple of years, it's very good once you have it setup. ---------------------------------------------------------------------- root-node · 2023-12-07 12:54 The thing that you will find is the same that Amazon and Microsoft found - it will eventually only be used to set timers. I setup and used Rhasspy for a lot of my home automation stuff and to look up information. The only thing I use it for now is to set cooking timers and to turn off a light at night, everything else I had it configured for just never got used.