chatgpt alternative reddit / selfhosted ---------------------------------------------------------------------- niemand112233 · 2023-12-08 11:03 I have a quite powerfull server with a good NVidia GPU. I would like to install something like ChatGPT. What I need: \- selfhosted on a Linux-Server --> WebGUI \- GPU Acceleration \- The possibility to upload PDFs, which should be processed and e.g. summarized. ​ What would you suggest? ​ ---------------------------------------------------------------------- shikabane · 2023-12-08 11:19 I suggest ChatGPT ---------------------------------------------------------------------- raffaeleguidi · 2023-12-08 11:32 Ollama checks a lot of these bullets ---------------------------------------------------------------------- spideraxal · 2023-12-08 11:55 H2O GPT can do that. You can give it a folder with documents, it will parse them and try to answer questions while taking into consideration those documents (using LangChain). From what I tested, it's not the best or most optimised or most accurate, but it can do all the points you mentioned out of the box. Here's the links: https://github.com/h2oai/h2ogpt/blob https://github.com/h2oai/h2ogpt/blob/main/docs/README_LangChain.md ---------------------------------------------------------------------- raffaeleguidi · 2023-12-08 11:55 Also - it even works without GPUs! ---------------------------------------------------------------------- horus-heresy · 2023-12-08 12:21 A lot of companies restricted chatgpt because of the IP and safety of corporate data. You should be cognizant of what you put into chatgpt as well ---------------------------------------------------------------------- DarkKnyt · 2023-12-08 13:08 Since I have it open: https://github.com/ollama-webui/ollama-webui ---------------------------------------------------------------------- niemand112233 · 2023-12-08 13:29 When you tell me how I can install ChatGPT on my own server? ---------------------------------------------------------------------- niemand112233 · 2023-12-08 13:29 Thx, I'll give it a try! ---------------------------------------------------------------------- niemand112233 · 2023-12-08 13:29 Thx, I'll give it a try! ---------------------------------------------------------------------- terAREya · 2023-12-08 14:14 [https://github.com/serge-chat/serge](https://github.com/serge- chat/serge) ---------------------------------------------------------------------- Woke_killa · 2023-12-08 14:59 There is no alternative unless you just want to waste your weekend testing. ---------------------------------------------------------------------- iluanara · 2023-12-08 16:05 why ---------------------------------------------------------------------- Ordinary_Large · 2023-12-08 16:43 Is Voicechat available with any of these? I would like to have my personal AI to talk to ---------------------------------------------------------------------- niemand112233 · 2023-12-08 17:01 Does it support GPU? ---------------------------------------------------------------------- niemand112233 · 2023-12-08 17:05 I gave it a single PDF File with ~600 pages. Even after 1h of GPU processing it is not finished yet. I have ~2500 files with five and 40 pages, but some have 700 pages. How could I improve the speed without buying a new GPU? ---------------------------------------------------------------------- niemand112233 · 2023-12-08 17:07 I tried it but I couldn't run it. Since I am using mainly plain installs I am Not familar with docker. Is there a whole step by step tutorial? ---------------------------------------------------------------------- Woke_killa · 2023-12-08 17:33 Because it requires enormous computing power and data for training. ---------------------------------------------------------------------- clueless_ambition · 2023-12-08 17:56 If you weren’t already aware of this, there is a whole [website](https://huggingface.co/) that has a variety of AI that you can self host. ---------------------------------------------------------------------- EojjN · 2023-12-08 18:54 Learn how to use docker. It's pretty simple and you can do so much with it. I've had vast amounts of fun setting up a docker based home- server ---------------------------------------------------------------------- ieatrox · 2023-12-08 18:55 Head to /r/localllama and dig in ---------------------------------------------------------------------- noaccess · 2023-12-08 18:56 ironically chat gpt was the most help in setting it up for me. ---------------------------------------------------------------------- bdsmmaster007 · 2023-12-08 19:16 also wanted to recommend that sub ---------------------------------------------------------------------- highly_confusing · 2023-12-08 19:20 The github lists a way to install without docker. Give it a try. ---------------------------------------------------------------------- spideraxal · 2023-12-08 20:18 No idea to be honest. We tried it at my workplace and we quickly gave up on it soon after as well as jt was clunky, even though we tried it on an AWS GPU enabled EC2 instance. My only suggestion would be converting the PDFs to plain TXT. For us, those were parsed quicker than the others ---------------------------------------------------------------------- parttimekatze · 2023-12-08 21:27 Dunno why you got downvoted for asking a simple question. You sort of can do that, you can even talk to GPT 4 with the API, feed the output and input prompts to a TTS (Text to Speech) and Speech recognition service. Don't have any specific recommendations because so much has changed in 3 years, you don't really need to settle for Siri/Google voice assistant quality conversations anymore: both in terms of voice quality and content/functionality. ---------------------------------------------------------------------- _k4mpfk3ks_ · 2023-12-08 22:47 What about this? https://www.reddit.com/r/selfhosted/s/jLM0pWWxBm ---------------------------------------------------------------------- niemand112233 · 2023-12-08 22:57 That's why you usually use pretrained models ---------------------------------------------------------------------- niemand112233 · 2023-12-08 23:00 I tried it and it seems nice (but don't know if you can upload PDFs), but somewhen it stops responding. ---------------------------------------------------------------------- Beastmind · 2023-12-09 01:52 Haven't checked it yet but I saw the name Mistral today ---------------------------------------------------------------------- OccasionallyImmortal · 2023-12-09 04:27 [This tutorial was posted to localLLMA today](https://old.reddit.com/r /LocalLLaMA/comments/18dohlt/tutorial_use_real_books_wiki_pages_and_ev en/) and looks like it might be a good fit. ---------------------------------------------------------------------- Threezeley · 2023-12-09 06:50 I have a VM built in proxmox which has portainer installed, and I use portainer to manage my docker instances. Honestly it wasn't that bad to set up and it's pretty handy ---------------------------------------------------------------------- Woke_killa · 2023-12-09 08:27 These models are of low quality, they are many times stupider than openai models. ---------------------------------------------------------------------- mrarjonny · 2023-12-09 09:01 There is literally an Instal script to run it on baremetal . Copy and paste and it "just werks" ---------------------------------------------------------------------- integrate_2xdx_10_13 · 2023-12-10 01:10 If the GPU you’re talking about is the Nvidia Quadro P620 mentioned in another comment, I don’t think a lot of models are going to work. It’s 5 years old and wasn’t the best at the time, I’d put it at or under 3060 performance for this work.