GPU: From Physical Hardware to a VM to a Container

TL;DR To let an application inside a container running on a VM use an NVIDIA GPU: Pass the host’s GPU through to the VM. Use NVIDIA’s container runtime to expose the GPU inside the container. Use a device plugin for scheduling in Kubernetes. Passthrough in Proxmox VE Configure the Host Add IOMMU Parameters to GRUB Edit the file: $ vi /etc/default/grub You should find this line: GRUB_CMDLINE_LINUX_DEFAULT="quiet" Add the Intel or AMD IOMMU parameter, depending on your CPU: