Trying to fire up my first threadripper KVM guest with a 1080 passed through. It has been so long since I messed with this box I am forgetting stuff…
virsh # start Windows-10
error: Failed to start domain Windows-10
error: internal error: Unknown PCI header type ‘127’
Google hasn’t been very helpful…
XML here https://pastebin.com/wUKcKUzd
We need a bit more info. Can you please post your IOMMU groups, complete system specs and lspci -vnn output?
Typically that unknown pci header type indicates a GPU that hasn’t properly been de-initialized, Is this the first time you’re booting up they system?
41:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev ff) (prog-if ff)
!!! Unknown header type 7f
Kernel driver in use: vfio-pci
Kernel modules: nouveau
41:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev ff) (prog-if ff)
!!! Unknown header type 7f
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
08:00.0 USB controller [0c03]: ASMedia Technology Inc. Device [1b21:2142] (prog-if 30 [XHCI])
Subsystem: ASUSTeK Computer Inc. Device [1043:8756]
Flags: bus master, fast devsel, latency 0, IRQ 25, NUMA node 0
Memory at ef800000 (64-bit, non-prefetchable) [size=32K]
Capabilities: [50] MSI: Enable- Count=1/8 Maskable- 64bit+
Capabilities: [68] MSI-X: Enable+ Count=8 Masked-
Capabilities: [78] Power Management version 3
Capabilities: [80] Express Legacy Endpoint, MSI 00
Capabilities: [100] Advanced Error Reporting
Capabilities: [200] #19
Capabilities: [300] Latency Tolerance Reporting
Kernel driver in use: xhci_hcd
Looks like it is my built in USB 3.1 hub.
cat /etc/modprobe.d/vfio.conf
options vfio-pci ids=1b21:2142,10de:1b80,10de:10f0
#options vfio_iommu_type1 allow_unsafe_interrupts=1
options vfio-pci disable_vga=1
127 sounds like a reset issue. I have that when my USB 3.0 Fresco Logic doesn’t reset properly.
But yeah, USB Controllers likely work with pci-stub better than vfio-pci. Just be aware of reset issues.