Ollama - super easy to host local LLM
reddit / selfhosted

----------------------------------------------------------------------
Dissk · 2023-11-22 02:32

I coupled it with this to have a sort of locally hosted "ChatGPT"
style interface: https://github.com/ollama-webui/ollama-webui

----------------------------------------------------------------------
getgoingfast · 2023-11-22 03:03

Thanks for sharing this. Not an expert, so here goes my dumb
questions. Can we potentially train these model with local data kinds
of like Stable Diffusion checkpoints?

----------------------------------------------------------------------
SnooPets20 · 2023-11-22 03:12

I'm thoroughly disappointed by the lack of Obama memes in this repo.

----------------------------------------------------------------------
Pi_ofthe_Beholder · 2023-11-22 04:53

Thanks Ollama

----------------------------------------------------------------------
revereddesecration · 2023-11-22 06:36

https://github.com/imartinez/privateGPT

----------------------------------------------------------------------
getgoingfast · 2023-11-22 06:50

Thanks!!

----------------------------------------------------------------------
SungrayHo · 2023-11-22 07:09

Ollama works great with Big-AGI too, look it up on github.

----------------------------------------------------------------------
keixver · 2023-11-22 07:10

Someone granted your wish

----------------------------------------------------------------------
lilolalu · 2023-11-22 13:15

Oh AGI is here already... Who would have thought.

----------------------------------------------------------------------
SungrayHo · 2023-11-22 13:40

hah yeah no but I like this ui, some cool features and ability to use
all ollama models AND openai gpt4 api.

----------------------------------------------------------------------
graveyard_bloom · 2023-11-22 17:54

Ollama is pretty sweet, I'm self-hosting it using 3B models on an old
X79 server.  I created a neat terminal AI client that makes requests
to it on the local network - called "Jeeves Assistant".

----------------------------------------------------------------------
stable_maple · 2023-12-13 17:23

Can I have ollama look through local data? Something like
```
find all files in this directory that reference the g++ compiler:
/home/bill/docs
```