Virtualizing GPU's for AI, viable?
reddit / selfhosted

----------------------------------------------------------------------
ZAFJB · 2023-12-19 12:49

There are plenty of solutions on GitHub.

I don't know which would work well, or best so use this:
https://www.google.com/search?q=github+GPU+virtualisation

Some of these list may help you get there from an AI perspective:
https://www.google.com/search?q=github+awesome+AI

----------------------------------------------------------------------
gryd3 · 2023-12-20 07:30

Your milage may vary. Virtualizing a GPU can be tricky at times
depending on what you want to do.  It's simplest to just 'pass-
through' a GPU from the host to a VM.  Some cards can be virtualized
so that you can assign 1/4 or 1/2 of the resources to a VM, other
cards cannot. Typically the expensive A series or Quadro NVidia cards
can be split up, or there are some tricks you can pull off to split up
some consumer cards. I have no experience splitting up AMD or Intel
GPUs.