I suspect you had a similar fun endeavor as me, where a media server with GPU passed through to a VM in Proxmox is also used as a gaming desktop. Admittedly I don’t use it often, so fiddling with it is almost as rewarding as using it when it works.