This is a problem that Nvidia is capable of solving but they haven’t been interested in it for over a decade so I don’t see them starting now.

They actually recently open sourced a bunch of required infrastructure, and hired a bunch of the OSS driver maintainers.

It’s all still pretty crap, but there’s more hope now.