Self hosted LLM (custom embeddings)
reddit / selfhosted

----------------------------------------------------------------------
relativisticcobalt · 2023-09-27 12:16

Hi all,
Has anyone here ever created a self hosted LLM chatbot that allowed
custom embeddings? Say I want to add all my lecture notes and digital
textbooks for my field of study so that I can have an easy reference.
Is this possible?

----------------------------------------------------------------------
b_fraz1 · 2023-09-27 12:27

You'll probably be pleased with
[oobabooga](https://github.com/oobabooga/text-generation-webui)

----------------------------------------------------------------------
relativisticcobalt · 2023-09-27 12:32

This looks super interesting - thanks a lot I’ll check it out!

----------------------------------------------------------------------
b_fraz1 · 2023-09-27 13:13

🍻

----------------------------------------------------------------------
janaka_a · 2023-11-29 16:02

[Docq.AI](https://Docq.AI) (github.com/docqai/docq) is another option.
OSS so can self-host. You can either manually upload files or point it
at a G Drive or OneDrive folder.

For your use case SaaS could work nice as well also.