Problem with switching the boot GPU (and with some other things)

With a 1060 maybe but with a Vega64?
On the other hand, bandwidth on a VM seems to be limited anyway:

But for linux gaming it would definitely mean a performance loss.