Hey all- first post on l1t. Happy to have found a place with a lot of interested vfio pci-passthrough fans.
My saga is one that will sound familiar I’m sure. I can’t get pci-passthrough to work to save my life. Well might be a bit of an exaggeration. It all started 4 years ago. No- seriously though I did first try this about 4 years ago with a Gigabyte board and AMD setup that was supposed to be one of the early ones that did it. No luck then.
Fast forward to now- sick of dual booting (again) because my spurts in Windows are always centered around gaming sessions that don’t work in Linux under any combination of WINE, etc.
I have:
OS: Ubuntu 19.04 beta
Kernel: Linux phantomvirt 5.0.0-8-generic #9-Ubuntu SMP Tue Mar 12 21:58:11 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
MB: ASUS Prime x470 PRO
CPU: Ryzen 2700x
GPU (host): XFX RX 560
GPU (guest): XFX RX 580
IOMMU Group isolation looks good, vfio pci is being loaded for the guest card and we’re all set. Fire up the VM and it immediately pauses itself and dmesg shows:
[ 164.663625] vfio-pci 0000:09:00.0: enabling device (0000 -> 0003)
[ 164.663988] vfio_ecap_init: 0000:09:00.0 hiding ecap 0x19@0x270
[ 164.663997] vfio_ecap_init: 0000:09:00.0 hiding ecap 0x1b@0x2d0
[ 164.664004] vfio_ecap_init: 0000:09:00.0 hiding ecap 0x1e@0x370
[ 164.683602] vfio-pci 0000:09:00.1: enabling device (0000 -> 0002)
[ 165.903711] vfio_bar_restore: 0000:09:00.1 reset recovery - restoring bars
[ 165.923867] vfio_bar_restore: 0000:09:00.0 reset recovery - restoring bars
[ 165.934728] pcieport 0000:00:03.2: AER: Uncorrected (Non-Fatal) error received: 0000:00:00.0
[ 165.934734] pcieport 0000:00:03.2: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Receiver ID)
[ 165.934738] pcieport 0000:00:03.2: device [1022:1453] error status/mask=00200000/04400000
[ 165.934741] pcieport 0000:00:03.2: [21] ACSViol (First)
[ 165.934791] pcieport 0000:00:03.2: AER: Device recovery successful
[ 166.068160] AMD-Vi: Completion-Wait loop timed out
[ 166.196535] AMD-Vi: Completion-Wait loop timed out
[ 166.321823] AMD-Vi: Completion-Wait loop timed out
[ 166.926331] iommu ivhd0: Event logged [IOTLB_INV_TIMEOUT device=09:00.0 address=0xffe197760]
[ 166.937521] pcieport 0000:00:03.2: AER: Uncorrected (Non-Fatal) error received: 0000:00:00.0
[ 166.937528] pcieport 0000:00:03.2: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Receiver ID)
[ 166.937532] pcieport 0000:00:03.2: device [1022:1453] error status/mask=00200000/04400000
[ 166.937535] pcieport 0000:00:03.2: [21] ACSViol (First)
[ 166.937597] pcieport 0000:00:03.2: AER: Device recovery successful
[ 167.928209] iommu ivhd0: Event logged [IOTLB_INV_TIMEOUT device=09:00.0 address=0xffe197790]
[ 167.929276] pcieport 0000:00:03.2: AER: Uncorrected (Non-Fatal) error received: 0000:00:00.0
[ 167.929282] pcieport 0000:00:03.2: PCIe Bus Error: severity=Uncorrected (Non-Fatal), type=Transaction Layer, (Receiver ID)
[ 167.929287] pcieport 0000:00:03.2: device [1022:1453] error status/mask=00200000/04400000
[ 167.929290] pcieport 0000:00:03.2: [21] ACSViol (First)
[ 167.929355] pcieport 0000:00:03.2: AER: Device recovery successful
[ 168.930102] iommu ivhd0: Event logged [IOTLB_INV_TIMEOUT device=09:00.0 address=0xffe1977c0]
So my question is: Is this one of those hopeless cards?
And follow-up questions. Is there a card on Amazon I can buy today (preferably AMD) that is KNOWN to work in the $200-$300 range?
I’ve tried swapping the cards so the RX 560 is for the guest and I get the exact same results as above.
I’ve also tried an EVGA Geforce 750 Ti, PNY Geforce 740, EVGA Geforce GT 630 for the guest without success. But- to be fair to those cards they at least let me install Windows but then don’t work for various reasons. I may circle back to those and try more configurations to see if I can get them to work. They all displayed issues related to no video card ROM and or D3 stuck.
I also tried a PNY GTX1050 Ti that I’ve since returned to Best Buy.
I’ve also tried a mixture of QEMU directly and virt-manager.
But my first question is my main one: should I give up on this AMD card for guests?
Thanks for reading!