I’ve spent a decade working on and off on this in professional and personal settings.

If budget is no object it’s only kind of a pain in the ass with Nvidia’s vGPU solutions for data centers. Even with $10 grand spent there’s hypervisor compatibility issues, license servers, compatibility challenges with drivers for games/consumer OS’s on hypervisors, and other inane garbage.

Consumer wise it’s technically it’s the easiest it’s ever been with SRIOV support for hardware accelerating VMs on Intel 13 & 14 gen procs with iGPUs, however iGPU performance is kinda dogshit, drivers are currently kinda wonky, and multiple display heads being passed through to VMs is kind fucking weird for hypervisors.

On the docker side of things, since containers aren’t technically full kernels YMMV based on what you’re trying to accomplish. Technically nvidia container toolkit does support CUDA & display heads for containers: hub.docker.com/r/nvidia/vulkan/tags. I haven’t gotten it working yet, but this is the basis for my next set of experiments.