GPU: From Physical Hardware to a VM to a Container
TL;DR To let an application inside a container running on a VM use an NVIDIA GPU:
Pass the host’s GPU through to the VM. Use NVIDIA’s container runtime to expose the GPU inside the container. Use a device plugin for scheduling in Kubernetes. Passthrough in Proxmox VE Configure the Host Add IOMMU Parameters to GRUB Edit the file:
$ vi /etc/default/grub You should find this line:
GRUB_CMDLINE_LINUX_DEFAULT="quiet" Add the Intel or AMD IOMMU parameter, depending on your CPU: