Help me with an idea
reddit / selfhosted

----------------------------------------------------------------------
karthiceaswar · 2023-10-12 10:43

So, i recently got whiff of localAI. I am looking to implement localAI
(selfhost) to create a chatbot that gives details and explanation of
contracts that i could upload to it. Anyone could you suggest me a
modal to use or a simple overview on how should i proceed ? ( If
possible i can train the modal with those docs ).
Another one is that just like GPT but i want it to be specific like i
can give the modal the data and the GPT should answer in context with
those documents ( essentially the above one but on a wider scale ).
Thank you. Appreciate if anyone could point me to related documents or
repos.

----------------------------------------------------------------------
lilolalu · 2023-10-12 11:44

If by "modal" you mean "model"... maybe this?
https://github.com/arc53/DocsGPT

----------------------------------------------------------------------
karthiceaswar · 2023-10-12 11:49

Sry ya, been using RoR recently. It rubbed off.

----------------------------------------------------------------------
karthiceaswar · 2023-10-12 11:52

>https://github.com/arc53/DocsGPT

Will this work with localAI ? I cannot afford OpenAI API.

----------------------------------------------------------------------
lilolalu · 2023-10-12 12:02

Never heard of "local ai" which seems to be a replacement for OpenAI
API. Since docsGPT or LLama or other LLMs run locally on your machine,
they don't need to use OpenAIs api, you can access them through their
own API. So unless you want to able to switch back and forth between
using OpenAI and your local LLM why do you want OpenAI's API?

https://github.com/oobabooga/text-generation-webui

----------------------------------------------------------------------
lilolalu · 2023-10-12 12:06

https://www.llamaindex.ai/

----------------------------------------------------------------------
ZAFJB · 2023-10-12 15:19

https://gpt4all.io/index.html