milkjug, 1 year ago

This generally works for people who only need command-line or headless access though. I’ve been waiting for proper GPU virtualization and partitioning to actually work on consumer gpus for so long now that I’m doubtful it will ever be a thing. And the hardware industry has gradually transitioned to single GPU setups now so PCIe lanes for multi-GPU setups are harder to come by, especially with recent motherboards dedicating more and more PCIe lanes to NVMe slots. Still, even GPU pass-through with VFIO is not a trivial thing at all to get up and running. Its a travesty that CPU virtualization is so mature and far along in the consumer space, juxtaposed with a seemingly absolute big fat zero on the GPU virtualization front.

You could get away with using VMWare for their proprietary GPU virtualization feature but besides simple sandboxes for testing, I will not personally get too far into it as the experience is not great.