Problem with GPU Passthrough

[Gixxa]

So I was finally able to get my second GPU (EVGA 1060 SSC) as the prices came down a bit. Over the weekend I installed Debian 9.4 and followed this tutorial:

Play games in Windows on Linux! PCI passthrough quick guide

Hello all! I am Gray from GrayWolfTech. I make videos on Linux and other interesting technology. Wendell has given me permission to post my written guides here for my videos. This is great for two reasons: First it helps grow this community and second my videos reach a wider audience to share what I have learned. I look forward to posting all my guides and videos here, and I am more than happy to answer any questions about the guide you may have. – Onward! – Now it’s time for one of the coolest and more advanced capabilities of Linux. KVM, or kernel virtual machines. We are going to go through step by step, how to setup PCI pass-through to a Windows virtual machine on a Debian host to play games! Thanks to Redhat, KVM can run virtual machines with almost bare metal performance and supports a wide variety of other neat features. The one we are going to focus on in this video is of course, PCI pass-through. The process of allowing a virtual machine full access to a PCI express graphics card for gaming, CAD, or 3D rendering. With this neat capability, you can run Linux as your host OS, and then pass your GPU (or one of your GPUs if you have multiple) to a virtual machine to play games. Let’s go over the requirements for this project: First and most important, you should backup any data you have on your PC. If you know what you are doing then you will not lose anything, but accidentally selecting the wrong drive when installing can lead you to be very sad when you figure out the drive you wiped had all your really good porn on it. Second, this process will take time. For someone who is an experienced Linux user it should take about 20 minutes (not counting time to install Debian or recompile the kernel). For someone who is new it might take longer. Make sure you allow yourself an entire afternoon or a good chunk of 4-5 hours where you could potentially not have a working PC. Third, follow the instructions I lay out in the video. I will answer questions down belo…

Sadly my second GPU (EVGA 1080 SC) will not output a picture to my monitor with PIP enabled on my monitor I only see “No Signal”, same if I go to the DVI input directly.

My setup is:

• Threadripper 1950X@3,8 GHz
• ASRock X399 Taichi
• EVGA 1060 SSC (Main GPU in Debian, on the monitor with Displayport, PCIe Slot 1)
• EVGA 1080 SC (This one should be passed through to the vm, on the monitor with DVI, PCIe Slot 4)
• 32 GB TridentZ
• 500 GB 850 Evo (I am looking to expand this with a 860 Evo 1 TB for the VM and use the 850 for Debian)
• Everything is cooled with water.

Here are some outputs.

iommu grps (1080 is 14):

/sys/kernel/iommu_groups/0/devices/0000:00:01.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.1
/sys/kernel/iommu_groups/2/devices/0000:00:01.3
/sys/kernel/iommu_groups/3/devices/0000:00:02.0
/sys/kernel/iommu_groups/4/devices/0000:00:03.0
/sys/kernel/iommu_groups/5/devices/0000:00:03.1
/sys/kernel/iommu_groups/6/devices/0000:00:04.0
/sys/kernel/iommu_groups/7/devices/0000:00:07.0
/sys/kernel/iommu_groups/7/devices/0000:00:07.1
/sys/kernel/iommu_groups/7/devices/0000:0b:00.0
/sys/kernel/iommu_groups/7/devices/0000:0b:00.2
/sys/kernel/iommu_groups/7/devices/0000:0b:00.3
/sys/kernel/iommu_groups/8/devices/0000:00:08.0
/sys/kernel/iommu_groups/8/devices/0000:00:08.1
/sys/kernel/iommu_groups/8/devices/0000:0c:00.0
/sys/kernel/iommu_groups/8/devices/0000:0c:00.2
/sys/kernel/iommu_groups/8/devices/0000:0c:00.3
/sys/kernel/iommu_groups/9/devices/0000:00:14.0
/sys/kernel/iommu_groups/9/devices/0000:00:14.3
/sys/kernel/iommu_groups/10/devices/0000:00:18.0
/sys/kernel/iommu_groups/10/devices/0000:00:18.1
/sys/kernel/iommu_groups/10/devices/0000:00:18.2
/sys/kernel/iommu_groups/10/devices/0000:00:18.3
/sys/kernel/iommu_groups/10/devices/0000:00:18.4
/sys/kernel/iommu_groups/10/devices/0000:00:18.5
/sys/kernel/iommu_groups/10/devices/0000:00:18.6
/sys/kernel/iommu_groups/10/devices/0000:00:18.7
/sys/kernel/iommu_groups/11/devices/0000:00:19.0
/sys/kernel/iommu_groups/11/devices/0000:00:19.1
/sys/kernel/iommu_groups/11/devices/0000:00:19.2
/sys/kernel/iommu_groups/11/devices/0000:00:19.3
/sys/kernel/iommu_groups/11/devices/0000:00:19.4
/sys/kernel/iommu_groups/11/devices/0000:00:19.5
/sys/kernel/iommu_groups/11/devices/0000:00:19.6
/sys/kernel/iommu_groups/11/devices/0000:00:19.7
/sys/kernel/iommu_groups/12/devices/0000:01:00.0
/sys/kernel/iommu_groups/12/devices/0000:01:00.1
/sys/kernel/iommu_groups/12/devices/0000:01:00.2
/sys/kernel/iommu_groups/12/devices/0000:02:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:04.0
/sys/kernel/iommu_groups/12/devices/0000:02:05.0
/sys/kernel/iommu_groups/12/devices/0000:02:06.0
/sys/kernel/iommu_groups/12/devices/0000:02:07.0
/sys/kernel/iommu_groups/12/devices/0000:04:00.0
/sys/kernel/iommu_groups/12/devices/0000:05:00.0
/sys/kernel/iommu_groups/12/devices/0000:06:00.0
/sys/kernel/iommu_groups/13/devices/0000:08:00.0
/sys/kernel/iommu_groups/13/devices/0000:09:04.0
/sys/kernel/iommu_groups/13/devices/0000:09:04.1
/sys/kernel/iommu_groups/13/devices/0000:09:04.2
/sys/kernel/iommu_groups/14/devices/0000:0a:00.0
/sys/kernel/iommu_groups/14/devices/0000:0a:00.1
/sys/kernel/iommu_groups/15/devices/0000:40:01.0
/sys/kernel/iommu_groups/16/devices/0000:40:02.0
/sys/kernel/iommu_groups/17/devices/0000:40:03.0
/sys/kernel/iommu_groups/18/devices/0000:40:03.1
/sys/kernel/iommu_groups/19/devices/0000:40:04.0
/sys/kernel/iommu_groups/20/devices/0000:40:07.0
/sys/kernel/iommu_groups/20/devices/0000:40:07.1
/sys/kernel/iommu_groups/20/devices/0000:42:00.0
/sys/kernel/iommu_groups/20/devices/0000:42:00.2
/sys/kernel/iommu_groups/20/devices/0000:42:00.3
/sys/kernel/iommu_groups/21/devices/0000:40:08.0
/sys/kernel/iommu_groups/21/devices/0000:40:08.1
/sys/kernel/iommu_groups/21/devices/0000:43:00.0
/sys/kernel/iommu_groups/21/devices/0000:43:00.2
/sys/kernel/iommu_groups/22/devices/0000:41:00.0
/sys/kernel/iommu_groups/22/devices/0000:41:00.1

lspci -k:

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1450
Subsystem: ASRock Incorporation Device 1450
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 1451
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1451
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
Kernel driver in use: pcieport
Kernel modules: shpchp
00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
Kernel driver in use: pcieport
Kernel modules: shpchp
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
Kernel driver in use: pcieport
Kernel modules: shpchp
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
Kernel driver in use: pcieport
Kernel modules: shpchp
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
Kernel driver in use: pcieport
Kernel modules: shpchp
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
Subsystem: ASRock Incorporation FCH SMBus Controller
Kernel driver in use: piix4_smbus
Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
Subsystem: ASRock Incorporation FCH LPC Bridge
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1460
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1461
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1462
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1463
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1464
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1465
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1466
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1467
00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1460
00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1461
00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1462
00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1463
00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1464
00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1465
00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1466
00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1467
01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43ba (rev 02)
Subsystem: ASMedia Technology Inc. Device 1142
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b6 (rev 02)
Subsystem: ASMedia Technology Inc. Device 1062
Kernel driver in use: ahci
Kernel modules: ahci
01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b1 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
Kernel driver in use: pcieport
Kernel modules: shpchp
04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
Subsystem: ASRock Incorporation I211 Gigabit Network Connection
Kernel driver in use: igb
Kernel modules: igb
05:00.0 Network controller: Intel Corporation Device 24fb (rev 10)
Subsystem: Intel Corporation Device 2110
Kernel modules: iwlwifi
06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
Subsystem: ASRock Incorporation I211 Gigabit Network Connection
Kernel driver in use: igb
Kernel modules: igb
08:00.0 PCI bridge: Texas Instruments XIO2000(A)/XIO2200A PCI Express-to-PCI Bridge (rev 03)
Kernel modules: shpchp
09:04.0 USB controller: NEC Corporation OHCI USB Controller (rev 43)
Subsystem: NEC Corporation USB Controller
Kernel driver in use: ohci-pci
Kernel modules: ohci_pci
09:04.1 USB controller: NEC Corporation OHCI USB Controller (rev 43)
Subsystem: NEC Corporation USB Controller
Kernel driver in use: ohci-pci
Kernel modules: ohci_pci
09:04.2 USB controller: NEC Corporation uPD72010x USB 2.0 Controller (rev 04)
Subsystem: MosChip Semiconductor Technology Ltd. uPD72010x USB 2.0 Controller
Kernel driver in use: ehci-pci
Kernel modules: ehci_pci
0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: nouveau
0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 145a
0b:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 1456
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1456
Kernel driver in use: ccp
Kernel modules: ccp
0b:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 145c
Subsystem: Advanced Micro Devices, Inc. [AMD] Device d102
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1455
0c:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci
0c:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Device 1457
Subsystem: ASRock Incorporation Device 1220
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1450
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1450
40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 1451
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1451
40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
Kernel driver in use: pcieport
Kernel modules: shpchp
40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
Kernel driver in use: pcieport
Kernel modules: shpchp
40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
Kernel driver in use: pcieport
Kernel modules: shpchp
41:00.0 VGA compatible controller: NVIDIA Corporation GP106 [GeForce GTX 1060 6GB] (rev a1)
Subsystem: eVga.com. Corp. GP106 [GeForce GTX 1060 6GB]
Kernel modules: nouveau
41:00.1 Audio device: NVIDIA Corporation Device 10f1 (rev a1)
Subsystem: eVga.com. Corp. Device 6267
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 145a
42:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 1456
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1456
Kernel driver in use: ccp
Kernel modules: ccp
42:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 145c
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 145c
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1455
43:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
Subsystem: ASRock Incorporation FCH SATA Controller [AHCI mode]
Kernel driver in use: ahci
Kernel modules: ahci

and lspci -nn:

00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1450]
00:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Device [1022:1451]
00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
00:01.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]
00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]
00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 59)
00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1460]
00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1461]
00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1462]
00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1463]
00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1464]
00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1465]
00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1466]
00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1467]
00:19.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1460]
00:19.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1461]
00:19.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1462]
00:19.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1463]
00:19.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1464]
00:19.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1465]
00:19.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1466]
00:19.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1467]
01:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43ba] (rev 02)
01:00.1 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b6] (rev 02)
01:00.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b1] (rev 02)
02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b4] (rev 02)
02:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b4] (rev 02)
02:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b4] (rev 02)
02:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b4] (rev 02)
02:07.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43b4] (rev 02)
04:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
05:00.0 Network controller [0280]: Intel Corporation Device [8086:24fb] (rev 10)
06:00.0 Ethernet controller [0200]: Intel Corporation I211 Gigabit Network Connection [8086:1539] (rev 03)
08:00.0 PCI bridge [0604]: Texas Instruments XIO2000(A)/XIO2200A PCI Express-to-PCI Bridge [104c:8231] (rev 03)
09:04.0 USB controller [0c03]: NEC Corporation OHCI USB Controller [1033:0035] (rev 43)
09:04.1 USB controller [0c03]: NEC Corporation OHCI USB Controller [1033:0035] (rev 43)
09:04.2 USB controller [0c03]: NEC Corporation uPD72010x USB 2.0 Controller [1033:00e0] (rev 04)
0a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP104 [GeForce GTX 1080] [10de:1b80] (rev ff)
0a:00.1 Audio device [0403]: NVIDIA Corporation GP104 High Definition Audio Controller [10de:10f0] (rev ff)
0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
0b:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Device [1022:1456]
0b:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:145c]
0c:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:1455]
0c:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
0c:00.3 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Device [1022:1457]
40:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1450]
40:00.2 IOMMU [0806]: Advanced Micro Devices, Inc. [AMD] Device [1022:1451]
40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1453]
40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]
40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:1452]
40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:1454]
41:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106 [GeForce GTX 1060 6GB] [10de:1c03] (rev a1)
41:00.1 Audio device [0403]: NVIDIA Corporation Device [10de:10f1] (rev a1)
42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:145a]
42:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Device [1022:1456]
42:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:145c]
43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device [1022:1455]
43:00.2 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)

I followed the tutorial from Gray to a t, except the ACS patch since my 1080 is the only device in group 14. I was able to boot the VM with the build in monitor and I also installed Windows which worked with no problem. In Windows however the vm did not detect the 1080. So it feels like it is not passed through to the vm.

I don’t know what I’m doing wrong or if I am doing something wrong. I tried two methods 1. install Debian 9.4 and install the Nvidia drivers and reinstall but not install the Nvidia drivers because I though the Nvidia driver was catching the 1080 at boot and would not let it go for the vm. The only difference I was able to see was this:

Without Nvidia drivers:

0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: nouveau
0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel

With Nvidia drivers:

0a:00.0 VGA compatible controller: NVIDIA Corporation GP104 [GeForce GTX 1080] (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: nvidia
0a:00.1 Audio device: NVIDIA Corporation GP104 High Definition Audio Controller (rev ff)
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel

Anyone know what I could try or see the/a mistake I made?

[TheRatPack123]

I can’t help as I’m struggling to get passthrough working myself but you may want to post your grub file in /etc/default/grub (I think this is the location in debian, not sure though). And also the file where you declared the stub for the 1080.

[Gixxa]

As I said I followed the tutorial to a t. So my grub is basically standard with the exception of:

amd_iommu=on vfio-pci.ids=10de:1b80,10de:10f0

1b80 = GPU
10f0 = GPU HDMI Audio

on the GRUB_CMDLINE_LINUX_DEFAULT line.

What do you mean with:

And also the file where you declared the stub for the 1080?

[TheRatPack123]

In /etc/modprobe.d/vfio.conf (again I’m not sure this is the same location in debian) it would probably look something like this:

options vfio-pci ids=10de:1b80,10de:10f0

Then you do the usual updating the initial ram disk and grub. Not sure what the commands are for these in debian, I’ve been doing it with fedora using:

dracut –f --kver `uname –r`
grub2-mkconfig > /etc/grub2-efi.cfg

[Gixxa]

Yeah I already did that in grub, no need for anything else on Debian.

I did edit the /etc/modules and added:

vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

After that I ran update-initramfs -u

Again, I followed the tutorial from Gray to the letter with the exception of the ACS patch and the last part were I would hide the VM from the GPU, or to be more exact, to hide it from the Nvidia Windows driver as the GPU would not even load.

[imrazor]

Again, I followed the tutorial from Gray to the letter with the exception of the ACS patch and the last part were I would hide the VM from the GPU, or to be more exact, to hide it from the Nvidia Windows driver as the GPU would not even load.

Maybe I’m not following, but “hiding the VM” from the Nvidia Windows driver is crucial. Why did you skip that step?

What do you mean by “I was able to boot the VM with the build in monitor”? IIRC, GrayWolf’s tutorial involves removing the virtual graphics card from the VM and using the Nvidia GPU for Windows installation.

It looks like you have vfio configured correctly, so I suspect the problem lies with fooling the Nvidia windows driver into thinking its not running in a VM.

[Gixxa]

I skiped that step because the GPU would not power on.

With the build in monitor I mean the graphical console.

Now that you say it and me watching the video again it does say that “graphical console is not configured for guest” at around 13 min. That might be the Problem why the GPU is not turning on. Thanks for pointing that out. I’ll give it another shot on the weekend by that time I should have a 860 Evo with 1 TB were I can copy my current win 10 install to.

[GrayBoltWolf]

Generally the GPU will still boot just fine, just can’t install the Nvidia driver in a VM unless you have a Quadro or other enterprise-GPU.

[Gixxa]

Ok in that case there is another problem because that did not happen. As I’ve written the Input just said “No Signal”.

[Gixxa]

Quick Update:

The GPU now turns on and I get a signal to the monitor with Displayport.

I installed a Beta BIOS for my X399 Taichi and it worked without a flaw.