Nvidia Container Runtime
reddit / selfhosted

----------------------------------------------------------------------
AreYouEvenReal2 · 2023-11-16 12:18

Can I use the Nvidia Container Runtime to do hardware encoding for
something like Plex or Jellyfin? Does this require iommu? Can it work
with Proxmox? Does it only work for one container or multiple?

----------------------------------------------------------------------
neonsphinx · 2023-11-16 13:19

Ok. You don't have enough details here.

Does it require iommu? Not if you're using Debian on bare metal. It
does if you're using a hypervisor.

Can I use it on multiple containers? I haven't gotten it to work on a
LXC container, only a VM (I have been able to pass a Radeon GPU to a
container, quite easily in fact. But not Nvidia). If you have a GPU
with multiple dies, or one that can be segmented, then you can assign
one or more to each VM. But if not, the GPU in its entirety belongs to
one VM.

That's my experience in proxmox. It should be possible in other
hypervisors, with more complicated config.

----------------------------------------------------------------------
AreYouEvenReal2 · 2023-11-16 13:32

I am not talking about VMs of normal GPU passthrough. I am talking
about the Nvidia Container Runtime. I have since then tested and
confirmed I can share a GPU between host and multiple guest docker
containers on Windows. I am wondering if this is possible on Proxmox.
I also don't know if it requires iommu or not as the system I am
currently testing on is different to the one I intend to deploy on.
The deployment system is an old FX-6300 + 970A platform with some
iommu related bugs.

----------------------------------------------------------------------
Judgment_Common · 2023-11-22 03:31

I don’t know about on proxmox but in general I have an nvidia gpu
transcoding for my plex server through podman/nvidia container runtime
on centos