A selfhostable chatbot like character.ai/crushon.ai?
reddit / selfhosted

----------------------------------------------------------------------
Adrian_8115 · 2023-11-09 19:24

I've been experimenting with character.ai a bit recently, I thought it
was a bit too limiting so I switch to the uncensored version called
crushon.ai..

is there a free & selfhostable version or a another similar ai model?

----------------------------------------------------------------------
stupv · 2023-11-10 09:25

I really respect you for having the balls to request assistance with
this

----------------------------------------------------------------------
Affectionate-Pickle0 · 2023-11-10 10:10

You might want to check here for more info:
https://www.reddit.com/r/LocalLLaMA/.

----------------------------------------------------------------------
Adrian_8115 · 2023-11-10 11:08

Haha, why?

----------------------------------------------------------------------
Adrian_8115 · 2023-11-10 11:08

Oh thank you!

----------------------------------------------------------------------
Prudent-Artichoke-19 · 2023-11-11 07:18

Yeah I can help you with that.

You'll need to pick a model.

I prefer 70b and up. You'll need about 48GB of VRAM.

Or

You can run a Petals server with about 8GB of VRAM if you have Nvidia
GPU that is pascal or above.

Don't know what the guy above is on about. Probably just hate on ML/AI
because it's "fad-ish".

----------------------------------------------------------------------
Prudent-Artichoke-19 · 2023-11-11 07:18

?

----------------------------------------------------------------------
Adrian_8115 · 2023-11-11 19:17

Oh ok! I've sadly got a lack of vram.. I have a 3070 and just 64gb of
ram.. but still thanks!

----------------------------------------------------------------------
Prudent-Artichoke-19 · 2023-11-11 19:19

[Check this out then. ](https://petals.dev/)

You can contribute to a swarm that let's you have access to llms. Then
you can use the system input to create a character.

----------------------------------------------------------------------
EquivalentListen2454 · 2023-12-07 01:39

Self hosting is mostly for LLM, if you want one thats actually good
try muah ai. It has photos and voice unlike others where all you can
do is just chat

----------------------------------------------------------------------
Beerminer1 · 2023-12-09 19:47

a4wOLBUm code

----------------------------------------------------------------------
Aware_Target6656 · 2023-12-29 10:38

Self hosting is only for LLM,but you need to try muah ai. It has
photos and voice unlike others

----------------------------------------------------------------------
Cheap-Instance8236 · 2023-12-29 10:38

Self hosting is mostly for LLM, if you want one thats actually good
try muah ai. It has photos and voice unlike others where all you can
do is just chat