Containers that use GPU?
reddit / selfhosted

----------------------------------------------------------------------
noahmakesbeats · 2023-11-05 06:02

Other than Tdarr, Plex and Jellyfin, what are some neat containers
that take advantage of access to gpu that I can run?

----------------------------------------------------------------------
Marko16 · 2023-11-05 06:07

I run the following for my security system
https://www.codeproject.com/Articles/5322557/CodeProject-AI-Server-AI-
the-easy-way

----------------------------------------------------------------------
ericstern · 2023-11-05 07:10

I think some of the self hosted photo app software like immich or
photoprism can use hardware acceleration to speed up various
functions, face recognition etc. Not sure how far each one goes with
gpu use though.

----------------------------------------------------------------------
crankyjaaay · 2023-11-05 07:50

Frigate for NVR, it uses GPU for transcoding your security camera
feeds

----------------------------------------------------------------------
marmata75 · 2023-11-05 08:35

And Shinobi as well!

----------------------------------------------------------------------
CheebaSweets · 2023-11-05 10:49

iSpy, Photoprism & Handbrake - are a few :)

----------------------------------------------------------------------
lilolalu · 2023-11-05 11:11

Pretty much all the apps mentioned so far only use the video
transcoding part of the GPU, which is nice but can also be done on
your cpus transcoding accelerator (Intel Quicksync). If you have a
nice gaming GPU with lots of VRAM: welcome to the wonderful world of
machine learning.

Some services you can check out:

- stable diffusion / automatic1111 (text-to-image)
https://github.com/AUTOMATIC1111/stable-diffusion-webui

- oobabooga (frontend to large language models, LLM, think self hosted
ChatGPT)
https://github.com/oobabooga


- tortoise tts (high quality text to speech)
https://github.com/neonbjb/tortoise-tts

- tts Generation GUI (has musicGen and audioGEN for text-to-music and
text to audio)
https://github.com/rsxdalv/tts-generation-webui

- whisper ASR (super high quality transcription and translation, also
with spotting to SRT subtitles)
https://github.com/jhj0517/Whisper-WebUI

----------------------------------------------------------------------
RelinquishedAll · 2023-11-05 12:58

Plex, for transcoding media

----------------------------------------------------------------------
Lancaster1983 · 2023-11-05 13:12

Yes, OP said other than Plex.

----------------------------------------------------------------------
reklis · 2023-11-05 13:40

https://github.com/getumbrel/llama-gpt

----------------------------------------------------------------------
slevin71 · 2023-11-05 16:11

Emby

----------------------------------------------------------------------
xantheybelmont · 2023-11-05 17:27

Something tells me your field lies somewhere around radiology.

----------------------------------------------------------------------
Bagel42 · 2023-11-05 17:48

Also use Frigate as an NVR

----------------------------------------------------------------------
itsinthegame · 2023-11-05 23:00

Steamheadless

----------------------------------------------------------------------
falcorns_balls · 2023-11-12 15:37

Came in to mention handbrake also