Incorrect Max Boost Linux with 3960x

AWilson · January 26, 2020, 1:59pm

Hello,
I’ve built a threadripper 3960x system running the latest proxmox. I’ve noticed that the max boost clock speeds I’m getting are 3.8GHz. Further inspecting with the cpupower command:

    root@3960x:~# cpupower frequency-info
analyzing CPU 0:
  driver: acpi-cpufreq
  CPUs which run at the same hardware frequency: 0
  CPUs which need to have their frequency coordinated by software: 0
  maximum transition latency:  Cannot determine or is not supported.
  hardware limits: 2.20 GHz - 3.80 GHz
  available frequency steps:  3.80 GHz, 2.80 GHz, 2.20 GHz
  available cpufreq governors: conservative ondemand userspace powersave performance schedutil
  current policy: frequency should be within 2.20 GHz and 3.80 GHz.
                  The governor "performance" may decide which speed to use
                  within this range.
  current CPU frequency: 3.80 GHz (asserted by call to hardware)
  boost state support:
    Supported: no
    Active: no
    Boost States: 0
    Total States: 3
    Pstate-P0:  3800MHz
    Pstate-P1:  2800MHz
    Pstate-P2:  2200MHz

My kernel command line for systemd is as follows:

root@3960x:~# cat /etc/kernel/cmdline
root=ZFS=rpool/ROOT/pve-1 boot=zfs mce=off amd_iommu=on iommu=pt video=vesafb:off,efifb:off avic=1 vfio_iommu_type1.allow_unsafe_interrupts=1 pcie_aspm=off

Any ideas on why it thinks the max boost is only 3.8GHz and not 4.5GHz?

Thanks
Andrew

dispat0r · January 26, 2020, 4:04pm

Thats normal try reading the actual frequency with:
watch -n 1 grep MHz /proc/cpuinfo

AWilson · January 26, 2020, 4:23pm

running that just shows all cores hitting a max of 3.8GHz when fully loaded.

It seems like the cpu stats on max clock are incorrect and the system is just letting it hit 3.8GHz and nothing beyond. I have PBO turned off in the bios, any other settings I should look at? I’m running an MSI TRX40 Creator board.

Thanks!

dispat0r · January 26, 2020, 4:51pm

Strange I’m also using a TRX40 system and it boosts to 4,5Ghz und single/low core load.
Whats your kernel version and what about windows is it fine there?

nx2l · January 26, 2020, 5:04pm

Isn’t that what it is supposed to do.
Only a few cores should get to 4.5Ghz at once

dispat0r · January 26, 2020, 6:16pm

I missed that. Yeah then 3,8Ghz is normal unless PBO is active.

AWilson · January 26, 2020, 9:30pm

Linux version 5.3.10-1-pve (build@pve) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP PVE 5.3.10-1 (Thu, 14 Nov 2019 10:43:13 +0100)

AWilson · January 26, 2020, 9:32pm

According to the gamersnexus guys pbo is independent of the max boost.

As long as the thermals can accommodate, PBO just pushes the cpu frequency up to the max boost. The cpu should be able to hit max boost without PBO though.

AWilson · January 26, 2020, 9:34pm

I’ve tried it with PBO and without and get the same results, peak clock freq of 3.8GHz.

AWilson · January 26, 2020, 9:58pm

So the solution seems to be I just factory reset the bios. I must have flipped something but I can now boost up to 4.5GHz.
Thanks for the help debugging!

maximlevitsky · January 26, 2020, 10:21pm

Which motherboard you have BTW?

AWilson · January 26, 2020, 10:22pm

MSI Creator TRx40

maximlevitsky · January 26, 2020, 10:24pm

How is the VFIO on the board? Any info is welcome. Does the BIOS allow to select boot GPU?

AWilson · January 26, 2020, 10:38pm

Next time I reboot, I’ll take a look at the bios for boot GPU options.

Here is the output of lspci -v:

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Flags: fast devsel, NUMA node 0

00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Flags: fast devsel, IRQ 30, NUMA node 0
	Capabilities: [40] Secure device <?>
	Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+
	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [c8] Vendor Specific Information: Len=18 <?>

00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 32, NUMA node 0
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel, NUMA node 0

00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 33, NUMA node 0
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	Memory behind bridge: fb200000-fb2fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
	Subsystem: Micro-Star International Co., Ltd. [MSI] FCH SMBus Controller
	Flags: 66MHz, medium devsel, NUMA node 0
	Kernel driver in use: piix4_smbus
	Kernel modules: i2c_piix4, sp5100_tco

00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
	Subsystem: Micro-Star International Co., Ltd. [MSI] FCH LPC Bridge
	Flags: bus master, 66MHz, medium devsel, latency 0, NUMA node 0

00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0
	Flags: fast devsel, NUMA node 0

00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1
	Flags: fast devsel, NUMA node 0

00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2
	Flags: fast devsel, NUMA node 0

00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3
	Flags: fast devsel, NUMA node 0
	Kernel driver in use: k10temp
	Kernel modules: k10temp

00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4
	Flags: fast devsel, NUMA node 0

00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5
	Flags: fast devsel, NUMA node 0

00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6
	Flags: fast devsel, NUMA node 0

00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7
	Flags: fast devsel, NUMA node 0

01:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Flags: fast devsel, NUMA node 0
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

02:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Flags: fast devsel, NUMA node 0
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

02:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller (prog-if 30 [XHCI])
	Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller
	Flags: bus master, fast devsel, latency 0, IRQ 68, NUMA node 0
	Memory at fb200000 (64-bit, non-prefetchable) [size=1M]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] Transaction Processing Hints
	Kernel driver in use: xhci_hcd

20:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Flags: fast devsel

20:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Flags: fast devsel, IRQ 29
	Capabilities: [40] Secure device <?>
	Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+
	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [c8] Vendor Specific Information: Len=18 <?>

20:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 34
	Bus: primary=20, secondary=21, subordinate=21, sec-latency=0
	I/O behind bridge: 00001000-00001fff
	Memory behind bridge: c0300000-c03fffff
	Prefetchable memory behind bridge: 00000000d0000000-00000000e01fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

20:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 36
	Bus: primary=20, secondary=22, subordinate=22, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

20:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

20:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 37
	Bus: primary=20, secondary=23, subordinate=23, sec-latency=0
	Memory behind bridge: c0000000-c02fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

21:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon Pro WX 7100] (prog-if 00 [VGA controller])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere [Radeon Pro WX 7100]
	Flags: bus master, fast devsel, latency 0, IRQ 175
	Memory at d0000000 (64-bit, prefetchable) [size=256M]
	Memory at e0000000 (64-bit, prefetchable) [size=2M]
	I/O ports at 1000 [size=256]
	Memory at c0300000 (32-bit, non-prefetchable) [size=256K]
	Expansion ROM at c0340000 [disabled] [size=128K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Legacy Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [200] #15
	Capabilities: [270] #19
	Capabilities: [2b0] Address Translation Service (ATS)
	Capabilities: [2c0] Page Request Interface (PRI)
	Capabilities: [2d0] Process Address Space ID (PASID)
	Capabilities: [320] Latency Tolerance Reporting
	Capabilities: [328] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [370] L1 PM Substates
	Kernel driver in use: vfio-pci
	Kernel modules: amdgpu

21:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Ellesmere HDMI Audio [Radeon RX 470/480 / 570/580/590]
	Flags: bus master, fast devsel, latency 0, IRQ 174
	Memory at c0360000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Legacy Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [328] Alternative Routing-ID Interpretation (ARI)
	Kernel driver in use: vfio-pci
	Kernel modules: snd_hda_intel

22:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

23:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

23:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
	Flags: bus master, fast devsel, latency 0, IRQ 152
	Memory at c0100000 (32-bit, non-prefetchable) [size=1M]
	Memory at c0208000 (32-bit, non-prefetchable) [size=8K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=2 Masked-
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] Transaction Processing Hints
	Kernel driver in use: ccp
	Kernel modules: ccp

23:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller (prog-if 30 [XHCI])
	Subsystem: Micro-Star International Co., Ltd. [MSI] Starship USB 3.0 Host Controller
	Flags: bus master, fast devsel, latency 0, IRQ 77
	Memory at c0000000 (64-bit, non-prefetchable) [size=1M]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] Transaction Processing Hints
	Kernel driver in use: xhci_hcd

23:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
	Subsystem: Micro-Star International Co., Ltd. [MSI] Starship/Matisse HD Audio Controller
	Flags: bus master, fast devsel, latency 0, IRQ 172
	Memory at c0200000 (32-bit, non-prefetchable) [size=32K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] Transaction Processing Hints
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Flags: fast devsel

40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Flags: fast devsel, IRQ 28
	Capabilities: [40] Secure device <?>
	Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+
	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [c8] Vendor Specific Information: Len=18 <?>

40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 38
	Bus: primary=40, secondary=41, subordinate=49, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: f8000000-f8cfffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 39
	Bus: primary=40, secondary=4a, subordinate=4a, sec-latency=0
	Memory behind bridge: f9100000-f91fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:03.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 40
	Bus: primary=40, secondary=4b, subordinate=4b, sec-latency=0
	Memory behind bridge: f9000000-f90fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:03.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 41
	Bus: primary=40, secondary=4c, subordinate=4c, sec-latency=0
	Memory behind bridge: f8f00000-f8ffffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:03.4 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 42
	Bus: primary=40, secondary=4d, subordinate=4d, sec-latency=0
	Memory behind bridge: f8e00000-f8efffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [380] Downstream Port Containment
	Capabilities: [3c4] #23
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 44
	Bus: primary=40, secondary=4e, subordinate=4e, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 46
	Bus: primary=40, secondary=4f, subordinate=4f, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

41:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57ad (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 26
	Bus: primary=41, secondary=42, subordinate=49, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: f8000000-f8cfffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Upstream Port, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [370] L1 PM Substates
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 47
	Bus: primary=42, secondary=43, subordinate=43, sec-latency=0
	Memory behind bridge: f8c00000-f8cfffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 48
	Bus: primary=42, secondary=44, subordinate=44, sec-latency=0
	Memory behind bridge: f8000000-f84fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 49
	Bus: primary=42, secondary=45, subordinate=45, sec-latency=0
	Memory behind bridge: f8b00000-f8bfffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a3 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 50
	Bus: primary=42, secondary=46, subordinate=46, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: f8a00000-f8afffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot+), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Device 7c59:1462
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [370] L1 PM Substates
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 51
	Bus: primary=42, secondary=47, subordinate=47, sec-latency=0
	Memory behind bridge: f8600000-f87fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1484
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 53
	Bus: primary=42, secondary=48, subordinate=48, sec-latency=0
	Memory behind bridge: f8900000-f89fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1484
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

42:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 57a4 (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 55
	Bus: primary=42, secondary=49, subordinate=49, sec-latency=0
	Memory behind bridge: f8800000-f88fffff
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Downstream Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1484
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

43:00.0 USB controller: ASMedia Technology Inc. Device 3242 (prog-if 30 [XHCI])
	Subsystem: Micro-Star International Co., Ltd. [MSI] Device 7c59
	Flags: bus master, fast devsel, latency 0, IRQ 54
	Memory at f8c00000 (64-bit, non-prefetchable) [size=32K]
	Capabilities: [50] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [68] MSI-X: Enable+ Count=8 Masked-
	Capabilities: [78] Power Management version 3
	Capabilities: [80] Express Legacy Endpoint, MSI 00
	Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 0201
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [200] #19
	Capabilities: [300] Latency Tolerance Reporting
	Capabilities: [400] L1 PM Substates
	Kernel driver in use: xhci_hcd

44:00.0 Ethernet controller: Aquantia Corp. AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] (rev 02)
	Subsystem: Micro-Star International Co., Ltd. [MSI] AQC107 NBase-T/IEEE 802.3bz Ethernet Controller [AQtion]
	Flags: bus master, fast devsel, latency 0, IRQ 135
	Memory at f8440000 (64-bit, non-prefetchable) [size=64K]
	Memory at f8450000 (64-bit, non-prefetchable) [size=4K]
	Memory at f8000000 (64-bit, non-prefetchable) [size=4M]
	Expansion ROM at f8400000 [disabled] [size=256K]
	Capabilities: [40] Express Endpoint, MSI 00
	Capabilities: [80] Power Management version 3
	Capabilities: [90] MSI-X: Enable+ Count=32 Masked-
	Capabilities: [a0] MSI: Enable- Count=1/32 Maskable- 64bit+
	Capabilities: [c0] Vital Product Data
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [150] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
	Capabilities: [180] #19
	Kernel driver in use: atlantic
	Kernel modules: atlantic

45:00.0 Network controller: Intel Corporation Device 2723 (rev 1a)
	Subsystem: Intel Corporation Device 0084
	Flags: bus master, fast devsel, latency 0, IRQ 26
	Memory at f8b00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [c8] Power Management version 3
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [40] Express Endpoint, MSI 00
	Capabilities: [80] MSI-X: Enable+ Count=16 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [14c] Latency Tolerance Reporting
	Capabilities: [154] L1 PM Substates
	Kernel driver in use: iwlwifi
	Kernel modules: iwlwifi

46:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
	Subsystem: Micro-Star International Co., Ltd. [MSI] I211 Gigabit Network Connection
	Flags: bus master, fast devsel, latency 0, IRQ 52
	Memory at f8a00000 (32-bit, non-prefetchable) [size=128K]
	I/O ports at 2000 [disabled] [size=32]
	Memory at f8a20000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number 00-d8-61-ff-ff-d7-1d-bc
	Capabilities: [1a0] Transaction Processing Hints
	Kernel driver in use: igb
	Kernel modules: igb

47:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

47:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller (prog-if 30 [XHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
	Flags: bus master, fast devsel, latency 0, IRQ 94
	Memory at f8700000 (64-bit, non-prefetchable) [size=1M]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: xhci_hcd

47:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller (prog-if 30 [XHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
	Flags: bus master, fast devsel, latency 0, IRQ 54
	Memory at f8600000 (64-bit, non-prefetchable) [size=1M]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=8 Masked-
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: xhci_hcd

48:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) (prog-if 01 [AHCI 1.0])
	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
	Flags: bus master, fast devsel, latency 0, IRQ 145
	Memory at f8900000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/16 Maskable- 64bit+
	Capabilities: [d0] SATA HBA v1.0
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: ahci
	Kernel modules: ahci

49:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51) (prog-if 01 [AHCI 1.0])
	Subsystem: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
	Flags: bus master, fast devsel, latency 0, IRQ 146
	Memory at f8800000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/16 Maskable- 64bit+
	Capabilities: [d0] SATA HBA v1.0
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [270] #19
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: ahci
	Kernel modules: ahci

4a:00.0 Non-Volatile memory controller: Phison Electronics Corporation Device 5016 (rev 01) (prog-if 02 [NVM Express])
	Subsystem: Phison Electronics Corporation Device 5016
	Flags: bus master, fast devsel, latency 0, IRQ 60, NUMA node 0
	Memory at f9100000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] Express Endpoint, MSI 00
	Capabilities: [d0] MSI-X: Enable+ Count=9 Masked-
	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [f8] Power Management version 3
	Capabilities: [100] Latency Tolerance Reporting
	Capabilities: [110] L1 PM Substates
	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1e0] #25
	Capabilities: [200] Advanced Error Reporting
	Capabilities: [300] #19
	Capabilities: [340] #26
	Capabilities: [378] #27
	Kernel driver in use: nvme

4b:00.0 Non-Volatile memory controller: Phison Electronics Corporation Device 5016 (rev 01) (prog-if 02 [NVM Express])
	Subsystem: Phison Electronics Corporation Device 5016
	Flags: bus master, fast devsel, latency 0, IRQ 62, NUMA node 0
	Memory at f9000000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] Express Endpoint, MSI 00
	Capabilities: [d0] MSI-X: Enable+ Count=9 Masked-
	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [f8] Power Management version 3
	Capabilities: [100] Latency Tolerance Reporting
	Capabilities: [110] L1 PM Substates
	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1e0] #25
	Capabilities: [200] Advanced Error Reporting
	Capabilities: [300] #19
	Capabilities: [340] #26
	Capabilities: [378] #27
	Kernel driver in use: nvme

4c:00.0 Non-Volatile memory controller: Phison Electronics Corporation Device 5016 (rev 01) (prog-if 02 [NVM Express])
	Subsystem: Phison Electronics Corporation Device 5016
	Flags: bus master, fast devsel, latency 0, IRQ 63, NUMA node 0
	Memory at f8f00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] Express Endpoint, MSI 00
	Capabilities: [d0] MSI-X: Enable+ Count=9 Masked-
	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [f8] Power Management version 3
	Capabilities: [100] Latency Tolerance Reporting
	Capabilities: [110] L1 PM Substates
	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1e0] #25
	Capabilities: [200] Advanced Error Reporting
	Capabilities: [300] #19
	Capabilities: [340] #26
	Capabilities: [378] #27
	Kernel driver in use: nvme

4d:00.0 Non-Volatile memory controller: Phison Electronics Corporation Device 5016 (rev 01) (prog-if 02 [NVM Express])
	Subsystem: Phison Electronics Corporation Device 5016
	Flags: bus master, fast devsel, latency 0, IRQ 66, NUMA node 0
	Memory at f8e00000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [80] Express Endpoint, MSI 00
	Capabilities: [d0] MSI-X: Enable+ Count=9 Masked-
	Capabilities: [e0] MSI: Enable- Count=1/8 Maskable- 64bit+
	Capabilities: [f8] Power Management version 3
	Capabilities: [100] Latency Tolerance Reporting
	Capabilities: [110] L1 PM Substates
	Capabilities: [128] Alternative Routing-ID Interpretation (ARI)
	Capabilities: [1e0] #25
	Capabilities: [200] Advanced Error Reporting
	Capabilities: [300] #19
	Capabilities: [340] #26
	Capabilities: [378] #27
	Kernel driver in use: nvme

4e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

4f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

60:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
	Flags: fast devsel

60:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
	Flags: fast devsel, IRQ 27
	Capabilities: [40] Secure device <?>
	Capabilities: [64] MSI: Enable+ Count=1/4 Maskable- 64bit+
	Capabilities: [74] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [c8] Vendor Specific Information: Len=18 <?>

60:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 57
	Bus: primary=60, secondary=61, subordinate=61, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

60:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
	Flags: fast devsel

60:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 59
	Bus: primary=60, secondary=62, subordinate=62, sec-latency=0
	Capabilities: [50] Power Management version 3
	Capabilities: [58] Express Root Port (Slot-), MSI 00
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
	Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27
	Kernel driver in use: pcieport

61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
	Flags: fast devsel
	Capabilities: [48] Vendor Specific Information: Len=08 <?>
	Capabilities: [50] Power Management version 3
	Capabilities: [64] Express Endpoint, MSI 00
	Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Capabilities: [150] Advanced Error Reporting
	Capabilities: [270] #19
	Capabilities: [2a0] Access Control Services
	Capabilities: [400] #25
	Capabilities: [410] #26
	Capabilities: [440] #27

AWilson · January 26, 2020, 10:42pm

Here are the iommu groupings:

/sys/kernel/iommu_groups/0/devices/0000:00:01.0
/sys/kernel/iommu_groups/1/devices/0000:00:02.0
/sys/kernel/iommu_groups/2/devices/0000:00:03.0
/sys/kernel/iommu_groups/3/devices/0000:00:04.0
/sys/kernel/iommu_groups/4/devices/0000:00:05.0
/sys/kernel/iommu_groups/5/devices/0000:00:07.0
/sys/kernel/iommu_groups/6/devices/0000:00:07.1
/sys/kernel/iommu_groups/7/devices/0000:00:08.0
/sys/kernel/iommu_groups/8/devices/0000:00:08.1
/sys/kernel/iommu_groups/9/devices/0000:00:14.0
/sys/kernel/iommu_groups/9/devices/0000:00:14.3
/sys/kernel/iommu_groups/10/devices/0000:00:18.0
/sys/kernel/iommu_groups/10/devices/0000:00:18.1
/sys/kernel/iommu_groups/10/devices/0000:00:18.2
/sys/kernel/iommu_groups/10/devices/0000:00:18.3
/sys/kernel/iommu_groups/10/devices/0000:00:18.4
/sys/kernel/iommu_groups/10/devices/0000:00:18.5
/sys/kernel/iommu_groups/10/devices/0000:00:18.6
/sys/kernel/iommu_groups/10/devices/0000:00:18.7
/sys/kernel/iommu_groups/11/devices/0000:01:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:00.0
/sys/kernel/iommu_groups/13/devices/0000:02:00.3
/sys/kernel/iommu_groups/14/devices/0000:20:01.0
/sys/kernel/iommu_groups/15/devices/0000:20:02.0
/sys/kernel/iommu_groups/16/devices/0000:20:03.0
/sys/kernel/iommu_groups/17/devices/0000:20:03.1
/sys/kernel/iommu_groups/18/devices/0000:20:04.0
/sys/kernel/iommu_groups/19/devices/0000:20:05.0
/sys/kernel/iommu_groups/20/devices/0000:20:07.0
/sys/kernel/iommu_groups/21/devices/0000:20:07.1
/sys/kernel/iommu_groups/22/devices/0000:20:08.0
/sys/kernel/iommu_groups/23/devices/0000:20:08.1
/sys/kernel/iommu_groups/24/devices/0000:21:00.0
/sys/kernel/iommu_groups/24/devices/0000:21:00.1
/sys/kernel/iommu_groups/25/devices/0000:22:00.0
/sys/kernel/iommu_groups/26/devices/0000:23:00.0
/sys/kernel/iommu_groups/27/devices/0000:23:00.1
/sys/kernel/iommu_groups/28/devices/0000:23:00.3
/sys/kernel/iommu_groups/29/devices/0000:23:00.4
/sys/kernel/iommu_groups/30/devices/0000:40:01.0
/sys/kernel/iommu_groups/31/devices/0000:40:01.1
/sys/kernel/iommu_groups/32/devices/0000:40:02.0
/sys/kernel/iommu_groups/33/devices/0000:40:03.0
/sys/kernel/iommu_groups/34/devices/0000:40:03.1
/sys/kernel/iommu_groups/35/devices/0000:40:03.2
/sys/kernel/iommu_groups/36/devices/0000:40:03.3
/sys/kernel/iommu_groups/37/devices/0000:40:03.4
/sys/kernel/iommu_groups/38/devices/0000:40:04.0
/sys/kernel/iommu_groups/39/devices/0000:40:05.0
/sys/kernel/iommu_groups/40/devices/0000:40:07.0
/sys/kernel/iommu_groups/41/devices/0000:40:07.1
/sys/kernel/iommu_groups/42/devices/0000:40:08.0
/sys/kernel/iommu_groups/43/devices/0000:40:08.1
/sys/kernel/iommu_groups/44/devices/0000:41:00.0
/sys/kernel/iommu_groups/45/devices/0000:42:02.0
/sys/kernel/iommu_groups/46/devices/0000:42:03.0
/sys/kernel/iommu_groups/47/devices/0000:42:04.0
/sys/kernel/iommu_groups/48/devices/0000:42:05.0
/sys/kernel/iommu_groups/49/devices/0000:42:08.0
/sys/kernel/iommu_groups/49/devices/0000:47:00.0
/sys/kernel/iommu_groups/49/devices/0000:47:00.1
/sys/kernel/iommu_groups/49/devices/0000:47:00.3
/sys/kernel/iommu_groups/50/devices/0000:42:09.0
/sys/kernel/iommu_groups/50/devices/0000:48:00.0
/sys/kernel/iommu_groups/51/devices/0000:42:0a.0
/sys/kernel/iommu_groups/51/devices/0000:49:00.0
/sys/kernel/iommu_groups/52/devices/0000:43:00.0
/sys/kernel/iommu_groups/53/devices/0000:44:00.0
/sys/kernel/iommu_groups/54/devices/0000:45:00.0
/sys/kernel/iommu_groups/55/devices/0000:46:00.0
/sys/kernel/iommu_groups/56/devices/0000:4a:00.0
/sys/kernel/iommu_groups/57/devices/0000:4b:00.0
/sys/kernel/iommu_groups/58/devices/0000:4c:00.0
/sys/kernel/iommu_groups/59/devices/0000:4d:00.0
/sys/kernel/iommu_groups/60/devices/0000:4e:00.0
/sys/kernel/iommu_groups/61/devices/0000:4f:00.0
/sys/kernel/iommu_groups/62/devices/0000:60:01.0
/sys/kernel/iommu_groups/63/devices/0000:60:02.0
/sys/kernel/iommu_groups/64/devices/0000:60:03.0
/sys/kernel/iommu_groups/65/devices/0000:60:04.0
/sys/kernel/iommu_groups/66/devices/0000:60:05.0
/sys/kernel/iommu_groups/67/devices/0000:60:07.0
/sys/kernel/iommu_groups/68/devices/0000:60:07.1
/sys/kernel/iommu_groups/69/devices/0000:60:08.0
/sys/kernel/iommu_groups/70/devices/0000:60:08.1
/sys/kernel/iommu_groups/71/devices/0000:61:00.0
/sys/kernel/iommu_groups/72/devices/0000:62:00.0

AWilson · January 26, 2020, 10:43pm

let me know if you have a specific listing you want to take a look at, I’ll gladly oblige.

AWilson · January 27, 2020, 4:41pm

I did not see an option to select which GPU to boot. I only have one GPU in the system so perhaps that option doesn’t show up until there are multiple cards installed…

maximlevitsky · January 27, 2020, 11:06pm

Could you post output of lsusb, lsusb -t and dmesg somewhere? I am curious how they managed to put 10 USB 3 ports on the chipset since chipset should support only 8. They must have used an internal USB3 hub for that.

Rest of the things I am worried about you can’t test since you don’t have multiple GPUs. In particular I hear that Zenith extreme 2 doesn’t even boot with more that 2 GPUs… for such expensive board this is such a shame.

If you have some spare time you could try to see how well the Asmedia USB controller works for passthrough. Asmedia is supposed to be shit, but this controller is relatively new and I heard that it does work somewhere.

Of course if you have any issues, I would like to hear. MSI boards are very big unknown to me.

For example on Zenith Extreme 2, which is more known to me, there are very funny issues for example,
https://rog.asus.com/forum/forumdisplay.php?299-Zenith-Extreme-amp-Strix-X399-E-Motherboards

I am more and more thinking to get the Gigabyte Designare TRX40.

AWilson · January 30, 2020, 3:44am

root@3960x:~# lsusb
Bus 009 Device 005: ID 1e71:170e NZXT 
Bus 009 Device 004: ID 1e71:2006 NZXT 
Bus 009 Device 003: ID 05e3:0608 Genesys Logic, Inc. Hub
Bus 009 Device 002: ID 8087:0029 Intel Corp. 
Bus 009 Device 008: ID 04f2:0833 Chicony Electronics Co., Ltd KU-0833 Keyboard
Bus 009 Device 007: ID 046d:c01d Logitech, Inc. MX510 Optical Mouse
Bus 009 Device 006: ID 0451:8043 Texas Instruments, Inc. Hub
Bus 009 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 010 Device 002: ID 0451:8041 Texas Instruments, Inc. Hub
Bus 010 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 008 Device 002: ID 174c:3074 ASMedia Technology Inc. ASM1074 SuperSpeed hub
Bus 008 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 007 Device 004: ID 1462:7c59 Micro Star International 
Bus 007 Device 003: ID 0db0:0d64 Micro Star International 
Bus 007 Device 002: ID 174c:2074 ASMedia Technology Inc. ASM1074 High-Speed hub
Bus 007 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 006 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 005 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 004 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 003 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub

AWilson · January 30, 2020, 3:44am

root@3960x:~# lsusb -t
/:  Bus 10.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 10000M
    |__ Port 3: Dev 2, If 0, Class=Hub, Driver=hub/4p, 5000M
/:  Bus 09.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/6p, 480M
    |__ Port 3: Dev 6, If 0, Class=Hub, Driver=hub/4p, 480M
        |__ Port 4: Dev 8, If 0, Class=Human Interface Device, Driver=usbfs, 1.5M
        |__ Port 4: Dev 8, If 1, Class=Human Interface Device, Driver=usbfs, 1.5M
        |__ Port 3: Dev 7, If 0, Class=Human Interface Device, Driver=usbfs, 1.5M
    |__ Port 5: Dev 2, If 0, Class=Wireless, Driver=btusb, 12M
    |__ Port 5: Dev 2, If 1, Class=Wireless, Driver=btusb, 12M
    |__ Port 6: Dev 3, If 0, Class=Hub, Driver=hub/4p, 480M
        |__ Port 1: Dev 4, If 0, Class=Human Interface Device, Driver=usbhid, 12M
        |__ Port 4: Dev 5, If 0, Class=Human Interface Device, Driver=usbhid, 12M
/:  Bus 08.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/4p, 10000M
    |__ Port 2: Dev 2, If 0, Class=Hub, Driver=hub/4p, 5000M
/:  Bus 07.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/6p, 480M
    |__ Port 2: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M
    |__ Port 5: Dev 3, If 3, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 1, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 6, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 4, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 2, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 0, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 5: Dev 3, If 7, Class=Human Interface Device, Driver=usbhid, 480M
    |__ Port 5: Dev 3, If 5, Class=Audio, Driver=snd-usb-audio, 480M
    |__ Port 6: Dev 4, If 0, Class=Human Interface Device, Driver=usbhid, 12M
/:  Bus 06.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 10000M
/:  Bus 05.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/1p, 480M
/:  Bus 04.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 10000M
/:  Bus 03.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 480M
/:  Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 10000M
/:  Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/2p, 480M