Nitro - 3mb binary to self-host LLMs
reddit / selfhosted

----------------------------------------------------------------------
noobgolang · 2023-11-23 13:58

https://nitro.jan.ai/

----------------------------------------------------------------------
somebodyknows_ · 2023-11-23 15:45

So the binary hosts just a common api, if I understood right?

----------------------------------------------------------------------
noobgolang · 2023-11-23 15:57

ye its the same format as openai chatgpt api you can just replace it

----------------------------------------------------------------------
gsusgur · 2023-11-23 22:39

AGPL makes its use case very limited though.

----------------------------------------------------------------------
kerberjg · 2023-11-24 00:23

Why?

----------------------------------------------------------------------
Obvious-Double-8692 · 2023-11-24 03:21

Is this like Ollama, Local AI alternative stuff?

----------------------------------------------------------------------
noobgolang · 2023-11-24 03:24

sort-of, but it's lighter and small, suitable to run as a subprocess
for your app