I’m wondering if anyone else is running into similar issues when trying to pass through one of the new AMD cards to a win10 guest.
Hardware:
- CPU: 5900x
- Mobo: X570 Aorus master
- Memory: 64gb
- GPU1: Sapphire 6800xt nitro+ (for pass-through to win10)
- GPU2: Vega64 (for host Ubuntu 20.10 running Kernel 5.10)
OS: Ubuntu 20.10
Kernel: 5.10
AMD driver: amdgpu-pro-20.45-1164792-ubuntu-20.04.tar.xz
The VM can see the graphics card as a 6800xt but shows a code43 error on it, re-installing the drivers causes the host system to reboot making it a bit challenging to nab any output of whats crashing exactly. When booting the NVMe drive directly the drive works properly in Windows.
lspci -nnv
0d:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:73bf] (rev c1) (prog-if 00 [VGA controller])
Subsystem: Sapphire Technology Limited Device [1da2:e438]
Flags: fast devsel, IRQ 43, IOMMU group 30
Memory at 7400000000 (64-bit, prefetchable) [size=16G]
Memory at 7800000000 (64-bit, prefetchable) [size=256M]
I/O ports at f000 [size=256]
Memory at fca00000 (32-bit, non-prefetchable) [size=1M]
Expansion ROM at fcb00000 [disabled] [size=128K]
Capabilities: [48] Vendor Specific Information: Len=08 <?>
Capabilities: [50] Power Management version 3
Capabilities: [64] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Capabilities: [200] Physical Resizable BAR
Capabilities: [240] Power Budgeting <?>
Capabilities: [270] Secondary PCI Express
Capabilities: [2a0] Access Control Services
Capabilities: [2d0] Process Address Space ID (PASID)
Capabilities: [320] Latency Tolerance Reporting
Capabilities: [410] Physical Layer 16.0 GT/s <?>
Capabilities: [440] Lane Margining at the Receiver <?>
Kernel driver in use: vfio-pci
Kernel modules: amdgpu
0d:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:ab28]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:ab28]
Flags: fast devsel, IRQ 51, IOMMU group 31
Memory at fcb20000 (32-bit, non-prefetchable) [size=16K]
Capabilities: [48] Vendor Specific Information: Len=08 <?>
Capabilities: [50] Power Management version 3
Capabilities: [64] Express Legacy Endpoint, MSI 00
Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
Capabilities: [150] Advanced Error Reporting
Capabilities: [2a0] Access Control Services
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
kvm-ok
INFO: /dev/kvm exists
KVM acceleration can be used
sudo dmesg |grep AMD-Vi
[ 2.402816] pci 0000:00:00.2: AMD-Vi: IOMMU performance counters supported
[ 2.404178] pci 0000:00:00.2: AMD-Vi: Found IOMMU cap 0x40
[ 2.404178] pci 0000:00:00.2: AMD-Vi: Extended features (0x58f77ef22294ade):
[ 2.404181] AMD-Vi: Interrupt remapping enabled
[ 2.404181] AMD-Vi: Virtual APIC enabled
[ 2.404182] AMD-Vi: X2APIC enabled
[ 2.404305] AMD-Vi: Lazy IO/TLB flushing enabled
[ 4.938394] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel [email protected]
grub config
GRUB_CMDLINE_LINUX_DEFAULT=“quiet iommu=on amd_iommu=on kvm.ignore_msrs=1 iommu=pt video=efifb:off vfio-pci.ids=1002:73bf,1002:ab28 kvm_a
md.npt=1 kvm_amd.avic=1”
Any ideas?