Return to Level1Techs.com

Asus x299 Sage 10g and VFIO / IOMMU groups / GPU passthrough

#1

First off, long time first time. I’ve used this forum and Wendel’s guides in my virtualization / VFIO / PCIe passthrough journeys but I’ve never had the need to ask a question, the answers were usually out there.

Second off, I’m not sure exactly which category is best to post this in, so mods, feel free to point (or move) me in the right direction.

CPU: i9-7900x
Motherboard (current): Asus x299-E ROG
CPU Cooler: Kraken x62
Memory: 64gb 2666MHz
Storage: Samsung 950 Pro 256gb for host, see additional in profile
Video Card: EVGA FTW 1070 (host), EVGA FTW3 1080ti (guest)
Driver for Video Card: 390.77 from graphics-drivers ppa (guest), 398.82 (guest)
Power Supply: EVGA SuperNOVA 1000 G3, 80 Plus Gold 1000W
Operating System: Ubuntu 18.04.1 (host), Windows 10 Pro (Guest)
Monitor: Dell u3417w, 2x Dell u2717d, 2x older Asus 1080p
Expansion: Asus Hyper m.2 x16 w/ 2x Samsung 960 EVO

So as you can see I’m running a higher end system (I work from home as a Software Engineer + Sysadmin/“DevOps”) so there is justification to some of the extremeness - I’m running multiple LXD containers with multiple databases, KVM instances for testing out sysadmin automation development, and of course, my Windows 10 VM is always running in case I want to pop in for a round of PUBG or WoW or whatever.

Now, here comes my problem - I’m starved for PCIe lanes due to the routing of lanes to slots on my motherboard and running out of room on my “fast” zpool (ideally with ZFS you don’t want to go over 80% capacity, I’m just over 70%). I recently bought 2x Samsung 970 Pro 1TB to fill the remaining two slots in my Asus Hyper m.2 x16 expansion card (it’s basically a PCIe card that has 4x nvme slots - this functionality is supported by a feature called PCIe slot lane bifurcation, it allows splitting a x16 into 4x x4, or 8x into 2x x4).

So I have the drives, but the PCIe slot the expansion card is plugged into is physically wired for max x8, and I assume will only support two drives in the Hyper m.2 x16. I would happily reallocate lanes from my host GPU (1070), giving 8 of it’s 16 lanes to the expansion card to make it full x16. Or a little less happily from my guest GPU (1080ti) as it would be more likely to use the extra bandwidth, but would be much easier to do with PCIe passthrough.

Unfortunately I’m physically constrained for where I can locate the GPUs - the expansion card is single slot width and it just barely fits in my bottom slot (not to mention cuts off air intake to the 1080ti fans) - there is no other arrangement I can pull off in my current mobo / case that would fulfill my needs.

So, the way I’m looking at it now is I need either a new case, a new motherboard, or both.

I started doing some research and discovered the Asus x299 WS series, specifically the Asus x299 WS Sage 10g that was announced within the last few months. Unfortunately, this chip uses dual PLX PEX8747 multiplexers to artificially provide 7x “electrically” x16 PCIe slots - meaning no tomfoolery with lane assignment and x16 slots only having x8 physical lanes.

Now, I’d call myself mid-to-low level expertise in the virtualization technologies I’m using - I’m on my third PC build thats been running the same Windows 10 VM (although I’m now running a new W10 VM after switching to libvirt from command line qemu). BUT I have no idea what effect these dual PCIe multiplexers are going to have on IOMMU groups, as well as the PCIe port bifurcation required to run the Asus Hyper m.2 x16.

As you can see linked above, I have done some research, and discovered the multiplexer chip being used, and it’s datasheets. I also found a block diagram (!!!) of the motherboard in the manual online, I uploaded it as part of this post.

So, if you’ve made it this far, what say ye. Is this motherboard going to support both proper IOMMU groups and PCIe lane bifurcation? From the specs page on the PLX chips it marks DMA as -- and ACS/SRI as Yes - I’m pretty sure those relate to what I’m trying to do, but I’m not knowledgeable enough to know what it exactly means.

As for the case, If I don’t go for a Fractal Design R6 (I’m done with form over functionality, the Phanteks was pretty, but I moved into it from a Define R5 and I feel there is more functionality focus in the Define series). However, I am open to suggestions on other cases!

EDIT: I forgot to mention - I’ve read that these PLX multiplexer chips can add latency - I’m also open to totally different board suggestions, as long as they support the Hyper m.2 x16 and have acceptable IOMMU groups (preferably with a USB controller that can be passed through, currently I’m passing through the USB 3.1 controller, which is in it’s own group).

0 Likes

#2

I’ve never heard of an intel HEDT/server platform NOT having proper separation, and this looks similar to a similar server board implementation I’ve seen before that worked fine.

Obviously no one can say authoritatively without the board in their hands but my money’s on “yes.”

I’d recommend asking around in places like the TPP discord, too, to see if you can find anyone with hands on experience with the board.

UPDATE: Asked around for you, apparently the Xeon scalable sage has proper isolation, as well as their x99 ws board, which all work in the same way IIRC

0 Likes

#3

quickdry21, did you ever have any luck with the Sage mobo. I’m contemplating a build with this board and would like to know what you think of it and if it’s getting the job done. I’m trying to find a x299 board with 3 m.2 slots and 5 or more pcie slots, esecially one that doesn’t drop sata slots or bandwidth on slots when you have multiple m.2 in there. I really liked the Gigabyte Designaire, until I read the manula and saw that you lose a sata port for every m.2 you plug in. Please let me know what you ended up doing.

0 Likes

#4

I know this is an older thread but in case anyone is searching for info on the X299 Sage 10G and IOMMU groups, I installed it today and it looks pretty good. Here is the full lspci -nnk from my system:

00:00.0 Host bridge [0600]: Intel Corporation Sky Lake-E DMI3 Registers [8086:2020] (rev 04)
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. Sky Lake-E DMI3 Registers [1043:873c]
00:04.0 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. Sky Lake-E CBDMA Registers [1043:873c]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.1 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.2 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel modules: ioatdma
00:04.3 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.4 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.5 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.6 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:04.7 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers [8086:0000]
Kernel driver in use: ioatdma
Kernel modules: ioatdma
00:05.0 System peripheral [0880]: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers [8086:2024] (rev 04)
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. Sky Lake-E MM/Vt-d Configuration Registers [1043:873c]
00:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS [8086:2025] (rev 04)
DeviceName: Onboard - Other
00:05.4 PIC [0800]: Intel Corporation Sky Lake-E IOAPIC [8086:2026] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E IOAPIC [8086:2026]
00:08.0 System peripheral [0880]: Intel Corporation Sky Lake-E Ubox Registers [8086:2014] (rev 04)
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. Sky Lake-E Ubox Registers [1043:873c]
00:08.1 Performance counters [1101]: Intel Corporation Sky Lake-E Ubox Registers [8086:2015] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E Ubox Registers [8086:0000]
00:08.2 System peripheral [0880]: Intel Corporation Sky Lake-E Ubox Registers [8086:2016] (rev 04)
DeviceName: Onboard - Other
Subsystem: Intel Corporation Sky Lake-E Ubox Registers [8086:0000]
00:14.0 USB controller [0c03]: Intel Corporation 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller [8086:a2af]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. 200 Series/Z370 Chipset Family USB 3.0 xHCI Controller [1043:873c]
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci
00:14.2 Signal processing controller [1180]: Intel Corporation 200 Series PCH Thermal Subsystem [8086:a2b1]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. 200 Series PCH Thermal Subsystem [1043:873c]
00:16.0 Communication controller [0780]: Intel Corporation 200 Series PCH CSME HECI #1 [8086:a2ba]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. 200 Series PCH CSME HECI [1043:873c]
Kernel driver in use: mei_me
Kernel modules: mei_me
00:17.0 SATA controller [0106]: Intel Corporation 200 Series PCH SATA controller [AHCI mode] [8086:a282]
DeviceName: Onboard - SATA
Subsystem: ASUSTeK Computer Inc. 200 Series PCH SATA controller [AHCI mode] [1043:873c]
Kernel driver in use: ahci
Kernel modules: ahci
00:1b.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #17 [8086:a2e7] (rev f0)
Kernel driver in use: pcieport
00:1b.4 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #21 [8086:a2eb] (rev f0)
Kernel driver in use: pcieport
00:1d.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #9 [8086:a298] (rev f0)
Kernel driver in use: pcieport
00:1d.2 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #11 [8086:a29a] (rev f0)
Kernel driver in use: pcieport
00:1f.0 ISA bridge [0601]: Intel Corporation X299 Chipset LPC/eSPI Controller [8086:a2d2]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. X299 Chipset LPC/eSPI Controller [1043:873c]
00:1f.2 Memory controller [0580]: Intel Corporation 200 Series/Z370 Chipset Family Power Management Controller [8086:a2a1]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. 200 Series/Z370 Chipset Family Power Management Controller [1043:873c]
00:1f.3 Audio device [0403]: Intel Corporation 200 Series PCH HD Audio [8086:a2f0]
DeviceName: Onboard - Sound
Subsystem: ASUSTeK Computer Inc. 200 Series PCH HD Audio [1043:8724]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
00:1f.4 SMBus [0c05]: Intel Corporation 200 Series/Z370 Chipset Family SMBus Controller [8086:a2a3]
DeviceName: Onboard - Other
Subsystem: ASUSTeK Computer Inc. 200 Series/Z370 Chipset Family SMBus Controller [1043:873c]
Kernel driver in use: i801_smbus
Kernel modules: i2c_i801
02:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a808]
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM981/PM981 [144d:a801]
Kernel driver in use: nvme
03:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller [1b21:2142]
Subsystem: ASUSTeK Computer Inc. ASM2142 USB 3.1 Host Controller [1043:8756]
Kernel driver in use: vfio-pci
Kernel modules: xhci_pci
04:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM2142 USB 3.1 Host Controller [1b21:2142]
Subsystem: ASUSTeK Computer Inc. ASM2142 USB 3.1 Host Controller [1043:8756]
Kernel driver in use: vfio-pci
Kernel modules: xhci_pci
16:00.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port A [8086:2030] (rev 04)
Kernel driver in use: pcieport
16:05.0 System peripheral [0880]: Intel Corporation Sky Lake-E VT-d [8086:2034] (rev 04)
Subsystem: Intel Corporation Sky Lake-E VT-d [8086:0000]
16:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
16:05.4 PIC [0800]: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036] (rev 04)
Subsystem: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036]
16:08.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:08.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:09.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0a.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0a.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0e.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:0f.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:10.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:10.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:1d.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2054] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:1d.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2055] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:1d.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2056] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:1d.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2057] (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers [8086:0000]
16:1e.0 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2080] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.1 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2081] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.2 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2082] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.3 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2083] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.4 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2084] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.5 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2085] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
16:1e.6 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2086] (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers [8086:0000]
17:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
18:08.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
18:10.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
19:00.0 RAID bus controller [0104]: Broadcom / LSI MegaRAID SAS 2208 [Thunderbolt] [1000:005b] (rev 05)
Subsystem: Broadcom / LSI MegaRAID SAS 9286-8e [1000:9290]
Kernel driver in use: megaraid_sas
Kernel modules: megaraid_sas
1a:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP102 [GeForce GTX 1080 Ti] [10de:1b06] (rev a1)
Subsystem: ASUSTeK Computer Inc. GP102 [GeForce GTX 1080 Ti] [1043:85f1]
Kernel driver in use: vfio-pci
Kernel modules: nouveau, nvidia_drm, nvidia
1a:00.1 Audio device [0403]: NVIDIA Corporation GP102 HDMI Audio Controller [10de:10ef] (rev a1)
Subsystem: ASUSTeK Computer Inc. GP102 HDMI Audio Controller [1043:85f1]
Kernel driver in use: vfio-pci
Kernel modules: snd_hda_intel
64:00.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port A [8086:2030] (rev 04)
Kernel driver in use: pcieport
64:05.0 System peripheral [0880]: Intel Corporation Sky Lake-E VT-d [8086:2034] (rev 04)
Subsystem: Intel Corporation Sky Lake-E VT-d [8086:0000]
64:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
64:05.4 PIC [0800]: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036] (rev 04)
Subsystem: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036]
64:08.0 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2066] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
Kernel driver in use: skx_uncore
64:09.0 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2066] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
Kernel driver in use: skx_uncore
64:0a.0 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2040] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0a.1 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2041] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0a.2 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2042] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
Kernel driver in use: skx_uncore
64:0a.3 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2043] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0a.4 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2044] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0a.5 System peripheral [0880]: Intel Corporation Sky Lake-E LM Channel 1 [8086:2045] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LM Channel 1 [8086:0000]
64:0a.6 System peripheral [0880]: Intel Corporation Sky Lake-E LMS Channel 1 [8086:2046] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMS Channel 1 [8086:0000]
Kernel driver in use: skx_uncore
64:0a.7 System peripheral [0880]: Intel Corporation Sky Lake-E LMDP Channel 1 [8086:2047] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMDP Channel 1 [8086:0000]
64:0b.0 System peripheral [0880]: Intel Corporation Sky Lake-E DECS Channel 2 [8086:2048] (rev 04)
Subsystem: Intel Corporation Sky Lake-E DECS Channel 2 [8086:0000]
64:0b.1 System peripheral [0880]: Intel Corporation Sky Lake-E LM Channel 2 [8086:2049] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LM Channel 2 [8086:0000]
64:0b.2 System peripheral [0880]: Intel Corporation Sky Lake-E LMS Channel 2 [8086:204a] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMS Channel 2 [8086:0000]
Kernel driver in use: skx_uncore
64:0b.3 System peripheral [0880]: Intel Corporation Sky Lake-E LMDP Channel 2 [8086:204b] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMDP Channel 2 [8086:0000]
64:0c.0 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2040] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0c.1 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2041] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0c.2 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2042] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
Kernel driver in use: skx_uncore
64:0c.3 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2043] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0c.4 System peripheral [0880]: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:2044] (rev 04)
Subsystem: Intel Corporation Sky Lake-E Integrated Memory Controller [8086:0000]
64:0c.5 System peripheral [0880]: Intel Corporation Sky Lake-E LM Channel 1 [8086:2045] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LM Channel 1 [8086:0000]
64:0c.6 System peripheral [0880]: Intel Corporation Sky Lake-E LMS Channel 1 [8086:2046] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMS Channel 1 [8086:0000]
Kernel driver in use: skx_uncore
64:0c.7 System peripheral [0880]: Intel Corporation Sky Lake-E LMDP Channel 1 [8086:2047] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMDP Channel 1 [8086:0000]
64:0d.0 System peripheral [0880]: Intel Corporation Sky Lake-E DECS Channel 2 [8086:2048] (rev 04)
Subsystem: Intel Corporation Sky Lake-E DECS Channel 2 [8086:0000]
64:0d.1 System peripheral [0880]: Intel Corporation Sky Lake-E LM Channel 2 [8086:2049] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LM Channel 2 [8086:0000]
64:0d.2 System peripheral [0880]: Intel Corporation Sky Lake-E LMS Channel 2 [8086:204a] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMS Channel 2 [8086:0000]
Kernel driver in use: skx_uncore
64:0d.3 System peripheral [0880]: Intel Corporation Sky Lake-E LMDP Channel 2 [8086:204b] (rev 04)
Subsystem: Intel Corporation Sky Lake-E LMDP Channel 2 [8086:0000]
65:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
66:08.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
66:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
66:10.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8747 48-Lane, 5-Port PCI Express Gen 3 (8.0 GT/s) Switch [10b5:8747] (rev ca)
Kernel driver in use: pcieport
67:00.0 Serial Attached SCSI controller [0107]: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
Subsystem: Broadcom / LSI 9200-8e [LSI SAS 6Gb/s SAS/SATA PCIe x8 External HBA] [1000:3080]
Kernel driver in use: mpt3sas
Kernel modules: mpt3sas
68:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
Subsystem: Intel Corporation Gigabit CT Desktop Adapter [8086:a01f]
Kernel driver in use: vfio-pci
Kernel modules: e1000e
69:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a0] (rev c1)
Kernel driver in use: pcieport
6a:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:14a1]
Kernel driver in use: pcieport
6b:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:66af] (rev c1)
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 [Radeon VII] [1002:081e]
Kernel driver in use: amdgpu
Kernel modules: amdgpu
6b:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Vega 20 HDMI Audio [Radeon VII] [1002:ab20]
Kernel driver in use: snd_hda_intel
Kernel modules: snd_hda_intel
b2:00.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port A [8086:2030] (rev 04)
Kernel driver in use: pcieport
b2:03.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port D [8086:2033] (rev 04)
Kernel driver in use: pcieport
b2:05.0 System peripheral [0880]: Intel Corporation Sky Lake-E VT-d [8086:2034] (rev 04)
Subsystem: Intel Corporation Sky Lake-E VT-d [8086:0000]
b2:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
b2:05.4 PIC [0800]: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036] (rev 04)
Subsystem: Intel Corporation Sky Lake-E IOxAPIC Configuration Registers [8086:2036]
b2:12.0 Performance counters [1101]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204c] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers [8086:0000]
b2:12.1 Performance counters [1101]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204d] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers [8086:0000]
Kernel driver in use: skx_uncore
b2:12.2 System peripheral [0880]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204e] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers [8086:0000]
Kernel driver in use: skx_uncore
b2:15.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers [8086:0000]
b2:16.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers [8086:0000]
b2:16.4 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers [8086:0000]
b2:17.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
b3:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller SM951/PM951 [144d:a802] (rev 01)
Subsystem: Samsung Electronics Co Ltd NVMe SSD Controller SM951/PM951 [144d:a801]
Kernel driver in use: nvme
b4:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
Subsystem: ASUSTeK Computer Inc. Ethernet Controller 10G X550T [1043:8712]
Kernel driver in use: ixgbe
Kernel modules: ixgbe
b4:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
Subsystem: ASUSTeK Computer Inc. Ethernet Controller 10G X550T [1043:8712]
Kernel driver in use: ixgbe
Kernel modules: ixgbe

0 Likes