@kriss120 Thank you for putting that video together, I appreciate you taking the time.
I am at work at the moment and so my ability to test is somewhat limited to remote. I will attempt to replicate your setup exactly when I get back to my desk.
Until then I have double-checked my settings for iommu groups, grub, etc…
To recap:
OS & Kernel:
Ubuntu 18.04; 4.18.19-041819-generic
CPU & Mobo:
AMD Ryzen 7 2700X Eight-Core Processor
ASUS ROG Crosshair VI Hero X370
AMD-VI:
[ 0.761880] AMD-Vi: IOMMU performance counters supported
[ 0.764946] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[ 0.764948] AMD-Vi: Extended features (0xf77ef22294ada):
[ 0.764953] AMD-Vi: Interrupt remapping enabled
[ 0.764954] AMD-Vi: virtual APIC enabled
[ 0.765058] AMD-Vi: Lazy IO/TLB flushing enabled
Guest GPU:
(PCI-E x16/x8 Slot 1)
0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev a1)
0b:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
IOMMU Group:
(Only device in Group 16)
IOMMU Group 16 0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev a1)
IOMMU Group 16 0b:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
Grub:
GRUB_CMDLINE_LINUX_DEFAULT=“amd_iommu=on vfio-pci.ids=10de:1b80,10de:10f0”
/etc/initramfs-tools/modules:
softdep nvidia pre: vfio vfio_pci
vfio
vfio_iommu_type1
vfio_virqfd
options vfio_pci ids=10de:1b80,10de:10f0
vfio_pci ids=10de:1b80,10de:10f0
vfio_pci
nvidia
/etc/modules:
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd
#vfio_pci ids=10de:1b80,10de:10f0
/etc/modprobe.d/vfio.conf:
softdep nvidia pre: vfio vfio_pci
options vfio-pci ids=10de:1b80,10de:10f0
dmesg | grep -E “DMAR|IOMMU”"
[ 0.761880] AMD-Vi: IOMMU performance counters supported
[ 0.764946] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[ 0.765958] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
[ 104.648187] vboxpci: IOMMU found
lspci -nnv | less:
0b:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX
1080] [10de:1b80] (rev a1) (prog-if 00 [VGA controller])
Subsystem: eVga. Corp. GP104 [GeForce GTX 1080] [3842:6288]
Kernel driver in use: vfio-pci
Kernel modules: nvidiafb, nouveau, nvidia_drm, nvidia
0b:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev a1)
Subsystem: eVga. Corp. GP104 High Definition Audio Controller [3842:6288]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
At this point I am fairly confident that the iommu config and passthrough prep are correct. Further, when accessing a guest that has the 1080 card assigned to it, the card appears in windows device manager, just with error 43.
I am having to connect to the VM via remote desktop to see any of this, as the guest card does not output video to its dedicated monitor from the VM. When the host boots, the monitor shows modules loading, then hangs on:
“vfio-pci 0000.0b:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem”
Upon starting the VM this monitor goes black, then turns off with no signal.
Finally, I have tried various cpu configuration settings, none of them result in the desired “x logical cores” showing on the guest vm, but rather a single “virtual cpu”. The clock speed is fine, just missing the desired core/thread count.
Thank you for reading this far. For some reason this process is a bit of a struggle for me, trying to power through it.
Also, does this forum support spoilers or other ways to hide lengths of text unless selected?