GPU Pass Thru Virt-Manager (AMD)

Hi everyone, I’m new to both unix (Mint) and GPU Pass Thru (7900 XTX) and I’ve hit an uncommon issue. I’m able to force the gpu to use vfio-pci drivers but when booting Win10 with UEFI BIOS it crashes my cinnamon desktop–i’m able to log back in without seeing a bios screen. I’m really not sure what else to do. Any help would be much appreciated!

1. System report
System:
  Kernel: 6.8.0-40-generic x86_64 bits: 64 compiler: N/A Desktop: Cinnamon 6.0.4 tk: GTK 3.24.33
    wm: muffin vt: 7 dm: LightDM 1.30.0 Distro: Linux Mint 21.3 Virginia base: Ubuntu 22.04 jammy
Machine:
  Type: Desktop Mobo: Gigabyte model: B650M AORUS ELITE AX serial: <superuser required>
    UEFI: American Megatrends LLC. v: FA2a date: 12/21/2023
CPU:
  Info: 16-core model: AMD Ryzen 9 7950X bits: 64 type: MT MCP smt: enabled arch: Zen 3 rev: 2
    cache: L1: 1024 KiB L2: 16 MiB L3: 64 MiB
  Speed (MHz): avg: 1240 high: 5563 min/max: 400/5881 cores: 1: 4330 2: 400 3: 400 4: 4449
    5: 400 6: 400 7: 400 8: 400 9: 400 10: 400 11: 400 12: 400 13: 400 14: 400 15: 400 16: 400
    17: 400 18: 5563 19: 400 20: 4451 21: 400 22: 400 23: 400 24: 400 25: 400 26: 400 27: 400
    28: 400 29: 5108 30: 400 31: 400 32: 5384 bogomips: 287459
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
Graphics:
  Device-1: AMD vendor: ASRock driver: vfio-pci v: N/A pcie: speed: 16 GT/s lanes: 16
    bus-ID: 03:00.0 chip-ID: 1002:744c class-ID: 0300
  Device-2: AMD vendor: Gigabyte driver: N/A pcie: speed: 16 GT/s lanes: 16 bus-ID: 12:00.0
    chip-ID: 1002:164e class-ID: 0300
  Display: x11 server: X.Org v: 1.21.1.4 driver: X: loaded: ati,modesetting,radeon
    unloaded: fbdev,vesa gpu: vfio-pci display-ID: :0 screens: 1
  Screen-1: 0 s-res: 3440x1440 s-dpi: 96 s-size: 910x381mm (35.8x15.0") s-diag: 987mm (38.8")
  Monitor-1: None-1 res: 3440x1440 hz: 60 size: N/A
  OpenGL: renderer: llvmpipe (LLVM 17.0.4 256 bits) v: 4.5 Mesa 23.3.0-devel direct render: Yes
Audio:
  Device-1: AMD driver: vfio-pci pcie: speed: Unknown lanes: 63 bus-ID: 03:00.1 chip-ID: 1002:ab30
    class-ID: 0403
  Device-2: AMD driver: snd_hda_intel v: kernel pcie: speed: 16 GT/s lanes: 16 bus-ID: 12:00.1
    chip-ID: 1002:1640 class-ID: 0403
  Device-3: AMD Family 17h HD Audio vendor: Gigabyte driver: snd_hda_intel v: kernel pcie:
    speed: 16 GT/s lanes: 16 bus-ID: 12:00.6 chip-ID: 1022:15e3 class-ID: 0403
  Device-4: Yamaha Steinberg UR22C type: USB driver: snd-usb-audio bus-ID: 2-4.1.4.3:6
    chip-ID: 0499:172f class-ID: 0103
  Sound Server-1: ALSA v: k6.8.0-40-generic running: yes
  Sound Server-2: PulseAudio v: 15.99.1 running: yes
  Sound Server-3: PipeWire v: 0.3.48 running: yes
Network:
  Device-1: Realtek driver: rtw89_8852ce v: kernel pcie: speed: 5 GT/s lanes: 1 port: d000
    bus-ID: 09:00.0 chip-ID: 10ec:c852 class-ID: 0280
  IF: wlp9s0 state: up mac: <filter>
  Device-2: Realtek RTL8125 2.5GbE vendor: Gigabyte driver: r8169 v: kernel pcie: speed: 5 GT/s
    lanes: 1 port: c000 bus-ID: 0a:00.0 chip-ID: 10ec:8125 class-ID: 0200
  IF: enp10s0 state: up speed: 1000 Mbps duplex: full mac: <filter>
  IF-ID-1: virbr0 state: up speed: 10000 Mbps duplex: unknown mac: <filter>
  IF-ID-2: vnet0 state: unknown speed: 10000 Mbps duplex: full mac: <filter>
Bluetooth:
  Device-1: Realtek Bluetooth Radio type: USB driver: btusb v: 0.8 bus-ID: 1-6:3
    chip-ID: 0bda:0852 class-ID: e001 serial: <filter>
  Report: hciconfig ID: hci0 rfk-id: 0 state: up address: <filter>
Drives:
  Local Storage: total: 3.64 TiB used: 1.45 TiB (39.9%)
  ID-1: /dev/nvme0n1 vendor: Western Digital model: WD BLACK SN850X 4000GB size: 3.64 TiB
    speed: 63.2 Gb/s lanes: 4 type: SSD serial: <filter> rev: 624331WD temp: 43.9 C scheme: GPT
Partition:
  ID-1: / size: 3.58 TiB used: 742.96 GiB (20.3%) fs: ext4 dev: /dev/nvme0n1p2
  ID-2: /boot/efi size: 511 MiB used: 6.1 MiB (1.2%) fs: vfat dev: /dev/nvme0n1p1
Swap:
  ID-1: swap-1 type: file size: 2 GiB used: 0 KiB (0.0%) priority: -2 file: /swapfile
USB:
  Hub-1: 1-0:1 info: Hi-speed hub with single TT ports: 12 rev: 2.0 speed: 480 Mb/s
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-2: 1-4:2 info: Realtek RTS5411 Hub ports: 4 rev: 2.1 speed: 480 Mb/s chip-ID: 0bda:5411
    class-ID: 0900
  Hub-3: 1-4.1:4 info: VIA Labs Hub ports: 4 rev: 2.1 speed: 480 Mb/s chip-ID: 2109:2811
    class-ID: 0900
  Hub-4: 1-4.1.3:6 info: VIA Labs Hub ports: 4 rev: 2.1 speed: 480 Mb/s chip-ID: 2109:2811
    class-ID: 0900
  Device-1: 1-4.1.3.4:8 info: Areson Corp 2.4G Wireless Receiver type: Keyboard,Mouse
    driver: hid-generic,usbhid interfaces: 2 rev: 1.1 speed: 12 Mb/s power: 100mA chip-ID: 25a7:fa11
    class-ID: 0301
  Hub-5: 1-4.1.4:7 info: LG USA ASM107x ports: 4 rev: 2.1 speed: 480 Mb/s power: 100mA
    chip-ID: 043e:9a10 class-ID: 0900
  Device-1: 1-4.1.4.1:9 info: Apple Aluminium Keyboard (ANSI) type: Keyboard,Mouse
    driver: apple,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s power: 100mA chip-ID: 05ac:024f
    class-ID: 0301
  Device-2: 1-4.1.4.4:10 info: Texas Instruments TUSB3410 Microcontroller
    type: <vendor specific> driver: ti_usb_3410_5052,ti_usb_3410_5052_1 interfaces: 1 rev: 1.1
    speed: 12 Mb/s power: 100mA chip-ID: 0451:3410 class-ID: ff00 serial: <filter>
  Device-3: 1-6:3 info: Realtek Bluetooth Radio type: Bluetooth driver: btusb interfaces: 2
    rev: 1.0 speed: 12 Mb/s power: 500mA chip-ID: 0bda:0852 class-ID: e001 serial: <filter>
  Device-4: 1-7:5 info: Integrated Express ITE Device type: HID driver: hid-generic,usbhid
    interfaces: 1 rev: 2.0 speed: 12 Mb/s power: 100mA chip-ID: 048d:5702 class-ID: 0300
  Hub-6: 2-0:1 info: Super-speed hub ports: 5 rev: 3.1 speed: 20 Gb/s chip-ID: 1d6b:0003
    class-ID: 0900
  Hub-7: 2-4:2 info: Realtek Hub ports: 4 rev: 3.2 speed: 5 Gb/s chip-ID: 0bda:0411
    class-ID: 0900
  Hub-8: 2-4.1:3 info: VIA Labs Hub ports: 4 rev: 3.0 speed: 5 Gb/s chip-ID: 2109:8110
    class-ID: 0900
  Hub-9: 2-4.1.3:4 info: VIA Labs Hub ports: 4 rev: 3.0 speed: 5 Gb/s chip-ID: 2109:8110
    class-ID: 0900
  Hub-10: 2-4.1.4:5 info: LG USA ASM107x ports: 4 rev: 3.0 speed: 5 Gb/s power: 8mA
    chip-ID: 043e:9a11 class-ID: 0900
  Device-1: 2-4.1.4.3:6 info: Yamaha Steinberg UR22C type: Audio driver: snd-usb-audio
    interfaces: 4 rev: 3.1 speed: 5 Gb/s power: 496mA chip-ID: 0499:172f class-ID: 0103
  Hub-11: 3-0:1 info: Hi-speed hub with single TT ports: 2 rev: 2.0 speed: 480 Mb/s
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-12: 4-0:1 info: Super-speed hub ports: 2 rev: 3.1 speed: 10 Gb/s chip-ID: 1d6b:0003
    class-ID: 0900
  Hub-13: 5-0:1 info: Hi-speed hub with single TT ports: 2 rev: 2.0 speed: 480 Mb/s
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-14: 6-0:1 info: Super-speed hub ports: 2 rev: 3.1 speed: 10 Gb/s chip-ID: 1d6b:0003
    class-ID: 0900
  Hub-15: 7-0:1 info: Hi-speed hub with single TT ports: 1 rev: 2.0 speed: 480 Mb/s
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-16: 7-1:2 info: Genesys Logic Hub ports: 4 rev: 2.0 speed: 480 Mb/s power: 100mA
    chip-ID: 05e3:0608 class-ID: 0900
  Hub-17: 8-0:1 info: Linux Foundation 3.0 root hub ports: N/A rev: 3.0 speed: 5 Gb/s
    chip-ID: 1d6b:0003 class-ID: 0900
Sensors:
  System Temperatures: cpu: 45.0 C mobo: 37.0 C
  Fan Speeds (RPM): N/A
Repos:
  Packages: 2921 apt: 2893 flatpak: 28
  No active apt repos in: /etc/apt/sources.list
  No active apt repos in: /etc/apt/sources.list.d/amdgpu-proprietary.list
  Active apt repos in: /etc/apt/sources.list.d/amdgpu.list
    1: deb https: //repo.radeon.com/amdgpu/6.0/ubuntu jammy main
  Active apt repos in: /etc/apt/sources.list.d/docker.list
    1: deb [arch=amd64 signed-by=/etc/apt/keyrings/docker.asc] https: //download.docker.com/linux/ubuntu jammy stable
  Active apt repos in: /etc/apt/sources.list.d/official-package-repositories.list
    1: deb http: //packages.linuxmint.com virginia main upstream import backport
    2: deb http: //archive.ubuntu.com/ubuntu jammy main restricted universe multiverse
    3: deb http: //archive.ubuntu.com/ubuntu jammy-updates main restricted universe multiverse
    4: deb http: //archive.ubuntu.com/ubuntu jammy-backports main restricted universe multiverse
    5: deb http: //security.ubuntu.com/ubuntu/ jammy-security main restricted universe multiverse
  Active apt repos in: /etc/apt/sources.list.d/onedrive.list
    1: deb [arch=amd64 signed-by=/usr/share/keyrings/obs-onedrive.gpg] https: //download.opensuse.org/repositories/home:/npreining:/debian-ubuntu-onedrive/xUbuntu_22.04/ ./
  Active apt repos in: /etc/apt/sources.list.d/phoerious-keepassxc-jammy.list
    1: deb [signed-by=/etc/apt/keyrings/phoerious-keepassxc-jammy.gpg] https: //ppa.launchpadcontent.net/phoerious/keepassxc/ubuntu jammy main
  Active apt repos in: /etc/apt/sources.list.d/rocm.list
    1: deb [arch=amd64] https: //repo.radeon.com/rocm/apt/6.0 jammy main
  No active apt repos in: /etc/apt/sources.list.d/steam-beta.list
  Active apt repos in: /etc/apt/sources.list.d/steam-stable.list
    1: deb [arch=amd64,i386 signed-by=/usr/share/keyrings/steam.gpg] https: //repo.steampowered.com/steam/ stable steam
    2: deb-src [arch=amd64,i386 signed-by=/usr/share/keyrings/steam.gpg] https: //repo.steampowered.com/steam/ stable steam
  Active apt repos in: /etc/apt/sources.list.d/teamviewer.list
    1: deb [signed-by=/usr/share/keyrings/teamviewer-keyring.gpg] https: //linux.teamviewer.com/deb stable main
  Active apt repos in: /etc/apt/sources.list.d/ubuntu-toolchain-r-test-jammy.list
    1: deb [signed-by=/etc/apt/keyrings/ubuntu-toolchain-r-test-jammy.gpg] https: //ppa.launchpadcontent.net/ubuntu-toolchain-r/test/ubuntu jammy main
  Active apt repos in: /etc/apt/sources.list.d/vscode.list
    1: deb [arch=amd64,arm64,armhf] https: //packages.microsoft.com/repos/code stable main
Info:
  Processes: 532 Uptime: 10m wakeups: 0 Memory: 61.94 GiB used: 9.3 GiB (15.0%) Init: systemd
  v: 249 runlevel: 5 Compilers: gcc: 11.4.0 alt: 11/12 Client: Unknown python3.10 client
  inxi: 3.3.13
2. BIOS Settings (B650M AORUS ELITE AX)
Settings > IO Ports > Initial Display Output > IGD Video
Settings > IO Ports > Integrated Grpahics > Forced
Settings > IO Ports > UMA Modes > UMA Auto
Settings > AMD CBS > NBIO Common Options > GFX Configuration > IGPU Configuration > Auto
Settings > AMD CBS > NBIO Common Options > GFX Configuration > UMA Version > Auto
Settings > Boot > CMS Support > Disabled (from https://wiki.gentoo.org/wiki/GPU_passthrough_with_libvirt_qemu_kvm#Enabling_64-bit_PCI_Addressing_in_the_Switching_the_TianoCore_UEFI_BIOS)
3. Checking for iommu support
pencil@Pencil:~$ sudo dmesg | grep iommu
[sudo] password for pencil:           
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-6.8.0-40-generic root=UUID=e5ad9742-29cc-45c6-9677-f40193bfc40b ro amd_iommu=on iommu=pt vfio-pci.ids=1002:744c,1002:ab30
[    0.042076] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.8.0-40-generic root=UUID=e5ad9742-29cc-45c6-9677-f40193bfc40b ro amd_iommu=on iommu=pt vfio-pci.ids=1002:744c,1002:ab30
[    0.415745] iommu: Default domain type: Passthrough (set via kernel command line)
[    0.468302] pci 0000:00:01.0: Adding to iommu group 0
[    0.468317] pci 0000:00:01.1: Adding to iommu group 1
[    0.468331] pci 0000:00:01.2: Adding to iommu group 2
[    0.468352] pci 0000:00:02.0: Adding to iommu group 3
[    0.468367] pci 0000:00:02.1: Adding to iommu group 4
[    0.468387] pci 0000:00:03.0: Adding to iommu group 5
[    0.468407] pci 0000:00:04.0: Adding to iommu group 6
[    0.468429] pci 0000:00:08.0: Adding to iommu group 7
[    0.468443] pci 0000:00:08.1: Adding to iommu group 8
[    0.468458] pci 0000:00:08.3: Adding to iommu group 9
[    0.468485] pci 0000:00:14.0: Adding to iommu group 10
[    0.468499] pci 0000:00:14.3: Adding to iommu group 10
[    0.468567] pci 0000:00:18.0: Adding to iommu group 11
[    0.468582] pci 0000:00:18.1: Adding to iommu group 11
[    0.468596] pci 0000:00:18.2: Adding to iommu group 11
[    0.468610] pci 0000:00:18.3: Adding to iommu group 11
[    0.468624] pci 0000:00:18.4: Adding to iommu group 11
[    0.468638] pci 0000:00:18.5: Adding to iommu group 11
[    0.468653] pci 0000:00:18.6: Adding to iommu group 11
[    0.468667] pci 0000:00:18.7: Adding to iommu group 11
[    0.468682] pci 0000:01:00.0: Adding to iommu group 12
[    0.468697] pci 0000:02:00.0: Adding to iommu group 13
[    0.468720] pci 0000:03:00.0: Adding to iommu group 14
[    0.468737] pci 0000:03:00.1: Adding to iommu group 15
[    0.468751] pci 0000:04:00.0: Adding to iommu group 16
[    0.468766] pci 0000:05:00.0: Adding to iommu group 17
[    0.468781] pci 0000:06:00.0: Adding to iommu group 18
[    0.468796] pci 0000:06:01.0: Adding to iommu group 19
[    0.468810] pci 0000:06:02.0: Adding to iommu group 20
[    0.468827] pci 0000:06:03.0: Adding to iommu group 21
[    0.468841] pci 0000:06:04.0: Adding to iommu group 22
[    0.468857] pci 0000:06:05.0: Adding to iommu group 23
[    0.468872] pci 0000:06:06.0: Adding to iommu group 24
[    0.468887] pci 0000:06:07.0: Adding to iommu group 25
[    0.468902] pci 0000:06:08.0: Adding to iommu group 26
[    0.468916] pci 0000:06:0c.0: Adding to iommu group 27
[    0.468932] pci 0000:06:0d.0: Adding to iommu group 28
[    0.468937] pci 0000:09:00.0: Adding to iommu group 20
[    0.468943] pci 0000:0a:00.0: Adding to iommu group 21
[    0.468948] pci 0000:10:00.0: Adding to iommu group 27
[    0.468954] pci 0000:11:00.0: Adding to iommu group 28
[    0.468978] pci 0000:12:00.0: Adding to iommu group 29
[    0.468993] pci 0000:12:00.1: Adding to iommu group 30
[    0.469008] pci 0000:12:00.2: Adding to iommu group 31
[    0.469024] pci 0000:12:00.3: Adding to iommu group 32
[    0.469039] pci 0000:12:00.4: Adding to iommu group 33
[    0.469054] pci 0000:12:00.6: Adding to iommu group 34
[    0.469068] pci 0000:13:00.0: Adding to iommu group 35
[    0.624020] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
3.1 set grub
# /etc/default/grub
....
GRUB_CMDLINE_LINUX_DEFAULT="amd_iommu=on iommu=pt vfio-pci.ids=1002:744c,1002:ab30"
....

4.1. update grub + initramfs (No log here’s similar to (5))

4.2 set vfio.conf
# /etc/modprobe.d/vfio.conf 
options vfio-pci ids=1002:744c,1002:ab30
softdep drm pre: vfio vfio-pci

Reboot…

4.3 set blacklist-radeon.conf
# /etc/modprobe.d/blacklist-radeon.conf 
blacklist radeon
blacklist amdgpu

Had to use modules and initramfs since blacklisting did not work.

4.4 set etc/modules
# /etc/modules: kernel modules to load at boot time.
#
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.

vfio
vfio_iommu_type1
vfio_pci
vfio_virqrf
4.5 set initramfs-tools/modules
# /etc/initramfs-tools/modules
# List of modules that you want to include in your initramfs.
# They will be loaded at boot time in the order below.
#
# Syntax:  module_name [args ...]
#
# You must run update-initramfs(8) to effect this change.
#
# Examples:
#
# raid1
# sd_mod

vfio
vfio_iommu_type1
vfio_pci
vfio_virqrf
5. update grub + initramfs
pencil@Pencil:~$ sudo update-grub
Sourcing file `/etc/default/grub'
Sourcing file `/etc/default/grub.d/50_linuxmint.cfg'
Sourcing file `/etc/default/grub.d/init-select.cfg'
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.8.0-40-generic
Found initrd image: /boot/initrd.img-6.8.0-40-generic
Found linux image: /boot/vmlinuz-6.5.0-1027-oem
Found initrd image: /boot/initrd.img-6.5.0-1027-oem
Found linux image: /boot/vmlinuz-5.15.0-119-generic
Found initrd image: /boot/initrd.img-5.15.0-119-generic
Found linux image: /boot/vmlinuz-5.15.0-76-generic
Found initrd image: /boot/initrd.img-5.15.0-76-generic
Warning: os-prober will be executed to detect other bootable partitions.
Its output will be used to detect bootable binaries on them and create new boot entries.
Adding boot menu entry for UEFI Firmware Settings ...
done
pencil@Pencil:~$ sudo update-initramfs -u
update-initramfs: Generating /boot/initrd.img-6.8.0-40-generic

More rebooting… and finally

7. confirm GPU kernel driver (ASRock Phantom Gaming Radeon RX 7900 XTX 24GB GDDR6)
....
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Device 744c (rev c8)
	Subsystem: ASRock Incorporation Device 5304
	Kernel driver in use: vfio-pci
	Kernel modules: amdgpu
03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Device ab30
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device ab30
	Kernel driver in use: vfio-pci
	Kernel modules: snd_hda_intel
....

Tried using regular uefi firmware + OVMF and it gave a black screen shown. If it give it a few seconds, the mint login screen comes up and I can login normally.

libvirt log (UEFI firmware but still same issue as OVMF firmware)
# /var/log/libvirt/qemu/win10-2.log                                                      
-device pcie-root-port,port=20,chassis=5,id=pci.5,bus=pcie.0,addr=0x2.0x4 \
-device pcie-root-port,port=21,chassis=6,id=pci.6,bus=pcie.0,addr=0x2.0x5 \
-device pcie-root-port,port=22,chassis=7,id=pci.7,bus=pcie.0,addr=0x2.0x6 \
-device pcie-root-port,port=23,chassis=8,id=pci.8,bus=pcie.0,addr=0x2.0x7 \
-device pcie-root-port,port=24,chassis=9,id=pci.9,bus=pcie.0,multifunction=on,addr=0x3 \
-device pcie-root-port,port=25,chassis=10,id=pci.10,bus=pcie.0,addr=0x3.0x1 \
-device pcie-root-port,port=26,chassis=11,id=pci.11,bus=pcie.0,addr=0x3.0x2 \
-device pcie-root-port,port=27,chassis=12,id=pci.12,bus=pcie.0,addr=0x3.0x3 \
-device pcie-root-port,port=28,chassis=13,id=pci.13,bus=pcie.0,addr=0x3.0x4 \
-device pcie-root-port,port=29,chassis=14,id=pci.14,bus=pcie.0,addr=0x3.0x5 \
-device qemu-xhci,p2=15,p3=15,id=usb,bus=pci.2,addr=0x0 \
-device virtio-serial-pci,id=virtio-serial0,bus=pci.3,addr=0x0 \
-blockdev '{"driver":"file","filename":"/var/lib/libvirt/images/win10-2.qcow2","node-name":"libvirt-2-storage","auto-read-only":true,"discard":">
-blockdev '{"node-name":"libvirt-2-format","read-only":false,"discard":"unmap","driver":"qcow2","file":"libvirt-2-storage","backing":null}' \
-device ide-hd,bus=ide.0,drive=libvirt-2-format,id=sata0-0-0,bootindex=2 \
-blockdev '{"driver":"file","filename":"/home/pencil/Documents/VM ISO/tiny10 x64 23h2.iso","node-name":"libvirt-1-storage","auto-read-only":true>
-blockdev '{"node-name":"libvirt-1-format","read-only":true,"driver":"raw","file":"libvirt-1-storage"}' \
-device ide-cd,bus=ide.1,drive=libvirt-1-format,id=sata0-0-1,bootindex=1 \
-netdev tap,fd=33,id=hostnet0 \
-device e1000e,netdev=hostnet0,id=net0,mac=52:54:00:32:6b:ac,bus=pci.1,addr=0x0 \
-chardev pty,id=charserial0 \
-device isa-serial,chardev=charserial0,id=serial0 \
-chardev spicevmc,id=charchannel0,name=vdagent \
-device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.spice.0 \
-device usb-tablet,id=input0,bus=usb.0,port=1 \
-audiodev '{"id":"audio1","driver":"spice"}' \
-spice port=5900,addr=127.0.0.1,disable-ticketing=on,image-compression=off,seamless-migration=on \
-device qxl-vga,id=video0,ram_size=67108864,vram_size=67108864,vram64_size_mb=0,vgamem_mb=16,max_outputs=1,bus=pcie.0,addr=0x1 \
-device ich9-intel-hda,id=sound0,bus=pcie.0,addr=0x1b \
-device hda-duplex,id=sound0-codec0,bus=sound0.0,cad=0,audiodev=audio1 \
-chardev spicevmc,id=charredir0,name=usbredir \
-device usb-redir,chardev=charredir0,id=redir0,bus=usb.0,port=2 \
-chardev spicevmc,id=charredir1,name=usbredir \
-device usb-redir,chardev=charredir1,id=redir1,bus=usb.0,port=3 \
-device virtio-balloon-pci,id=balloon0,bus=pci.4,addr=0x0 \
-sandbox on,obsolete=deny,elevateprivileges=deny,spawn=deny,resourcecontrol=deny \
-msg timestamp=on
char device redirected to /dev/pts/0 (label charserial0)
2024-08-30T21:41:35.302983Z qemu-system-x86_64: terminating on signal 15 from pid 3444 (/usr/sbin/libvirtd)
2024-08-30 21:41:35.503+0000: shutting down, reason=destroyed

Error logs of libvirt guest. Same errors when starting the VM. Something to note. When the crash does happen, the virtual machine will hang and when opening Virtual Machine Manager states that Win10 is still running. I need to force close it to have it shutdown.

systemctl status libvirt-guests.service
pencil@Pencil:~$ sudo systemctl status libvirt-guests.service
○ libvirt-guests.service - Suspend/Resume Running libvirt Guests
     Loaded: loaded (/lib/systemd/system/libvirt-guests.service; enabled; vendor preset: enabled)
     Active: inactive (dead) since Fri 2024-08-30 23:44:26 PDT; 1s ago
       Docs: man:libvirtd(8)
             https://libvirt.org
    Process: 11019 ExecStart=/usr/lib/libvirt/libvirt-guests.sh start (code=exited, status=0/SUCCESS)
    Process: 11058 ExecStop=/usr/lib/libvirt/libvirt-guests.sh stop (code=exited, status=0/SUCCESS)
   Main PID: 11019 (code=exited, status=0/SUCCESS)
        CPU: 22ms

Aug 30 23:44:04 Pencil systemd[1]: Starting Suspend/Resume Running libvirt Guests...
Aug 30 23:44:04 Pencil libvirt-guests.sh[11025]: libvirt-guests is configured not to start any guests on boot
Aug 30 23:44:04 Pencil systemd[1]: Finished Suspend/Resume Running libvirt Guests.
Aug 30 23:44:26 Pencil systemd[1]: Stopping Suspend/Resume Running libvirt Guests...
Aug 30 23:44:26 Pencil libvirt-guests.sh[11067]: Running guests on default URI:
Aug 30 23:44:26 Pencil libvirt-guests.sh[11076]: no running guests.
Aug 30 23:44:26 Pencil systemd[1]: libvirt-guests.service: Deactivated successfully.
Aug 30 23:44:26 Pencil systemd[1]: Stopped Suspend/Resume Running libvirt Guests.

Is the behaviour the same:

  • with the audio device (1002:ab30) left out (though yes it’s reporting in another iommu group, and I’d expect it passed in, it’s potentially a complication)

  • if you detach the spice/ qemu video completely from the VM (connect a monitor to the card output)

  • does it occur with a linux VM (to isolate if it’s specific conditions inside the VM causing it)


Do you complete a w10 install or is this occurring in the install/oobe.

What driver is the internal gpu attaching (I feel it would be amd-ish, yet that module is blacklisted);
lspci -nnk |grep -A3 VGA

7900 seems to return to require some ‘special’ treatment for VFIO (i am not an expert in this). Though these aren’t the same symptoms this thread could provide some threads to pull on - https://forum.level1techs.com/t/7900-xtx-pci-reset-bug/192032/6

Seems there is an issue with an encrypted home directory. I would get encryptfs errors on dmesg.

  • with the audio device (1002:ab30) left out (though yes it’s reporting in another iommu group, and I’d expect it passed in, it’s potentially a complication)
    No luck leaving out the audio device.
  • if you detach the spice/ qemu video completely from the VM (connect a monitor to the card output)
    No luck with this too. Seems to be due to encrypted home dir
  • does it occur with a linux VM (to isolate if it’s specific conditions inside the VM causing it)
    Did not try this. Managed to brick my amdgpu drivers on host and could not recover. (Didn’t realize I installed the proprietary drivers from AMD causing a conflict at update

Anyways. Good news I got it up and running! with no AMD rest bug!

Updated to Mint 22. I’ll have to post a guide for my setup :slight_smile:

Thanks for the help!

System:
  Kernel: 6.8.0-41-generic arch: x86_64 bits: 64 compiler: gcc v: 13.2.0 clocksource: tsc
  Desktop: Cinnamon v: 6.2.9 tk: GTK v: 3.24.41 wm: Muffin v: 6.2.0 vt: 7 dm: LightDM v: 1.30.0
    Distro: Linux Mint 22 Wilma base: Ubuntu 24.04 noble
Machine:
  Type: Desktop Mobo: Gigabyte model: B650M AORUS ELITE AX serial: <superuser required>
    uuid: <superuser required> UEFI: American Megatrends LLC. v: FB3a date: 08/28/2024
CPU:
  Info: 16-core model: AMD Ryzen 9 7950X bits: 64 type: MT MCP smt: enabled arch: Zen 4 rev: 2
    cache: L1: 1024 KiB L2: 16 MiB L3: 64 MiB
  Speed (MHz): avg: 2344 high: 5492 min/max: 545/5881 cores: 1: 4717 2: 5489 3: 545 4: 5489
    5: 545 6: 545 7: 5488 8: 545 9: 545 10: 545 11: 3521 12: 545 13: 545 14: 545 15: 5440 16: 545
    17: 5491 18: 5489 19: 5492 20: 5488 21: 545 22: 545 23: 5490 24: 545 25: 3224 26: 545 27: 545
    28: 545 29: 3835 30: 545 31: 545 32: 545 bogomips: 287451
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
Graphics:
  Device-1: AMD Navi 31 [Radeon RX 7900 XT/7900 XTX/7900M] vendor: ASRock driver: vfio-pci v: N/A
    arch: RDNA-3 pcie: speed: 16 GT/s lanes: 16 bus-ID: 03:00.0 chip-ID: 1002:744c class-ID: 0300
  Device-2: AMD Raphael vendor: Gigabyte driver: amdgpu v: kernel arch: RDNA-2 pcie:
    speed: 16 GT/s lanes: 16 ports: active: DP-2 empty: DP-1, DP-3, HDMI-A-1, Writeback-1
    bus-ID: 12:00.0 chip-ID: 1002:164e class-ID: 0300 temp: 40.0 C
  Display: x11 server: X.Org v: 21.1.11 with: Xwayland v: 23.2.6 driver: X: loaded: amdgpu
    unloaded: fbdev,modesetting,radeon,vesa dri: radeonsi gpu: amdgpu display-ID: :0 screens: 1
  Screen-1: 0 s-res: 3440x1440 s-dpi: 96 s-size: 910x381mm (35.83x15.00") s-diag: 987mm (38.84")
  Monitor-1: DP-2 mapped: DisplayPort-1 model: LG (GoldStar) ULTRAWIDE serial: <filter>
    res: 3440x1440 hz: 60 dpi: 109 size: 800x335mm (31.5x13.19") diag: 867mm (34.1") modes:
    max: 3440x1440 min: 640x480
  API: EGL v: 1.5 hw: drv: amd radeonsi platforms: device: 0 drv: radeonsi device: 1 drv: swrast
    surfaceless: drv: radeonsi x11: drv: radeonsi inactive: gbm,wayland
  API: OpenGL v: 4.6 compat-v: 4.5 vendor: amd mesa v: 24.0.9-0ubuntu0.1 glx-v: 1.4
    direct-render: yes renderer: AMD Radeon Graphics (radeonsi raphael_mendocino LLVM 17.0.6 DRM
    3.57 6.8.0-41-generic) device-ID: 1002:164e
Audio:
  Device-1: AMD Navi 31 HDMI/DP Audio driver: vfio-pci pcie: speed: Unknown lanes: 63
    bus-ID: 03:00.1 chip-ID: 1002:ab30 class-ID: 0403
  Device-2: AMD Rembrandt Radeon High Definition Audio driver: snd_hda_intel v: kernel pcie:
    speed: 16 GT/s lanes: 16 bus-ID: 12:00.1 chip-ID: 1002:1640 class-ID: 0403
  Device-3: AMD Family 17h/19h HD Audio vendor: Gigabyte driver: snd_hda_intel v: kernel pcie:
    speed: 16 GT/s lanes: 16 bus-ID: 12:00.6 chip-ID: 1022:15e3 class-ID: 0403
  Device-4: Yamaha Steinberg UR22C driver: snd-usb-audio type: USB rev: 3.1 speed: 5 Gb/s
    lanes: 1 bus-ID: 2-4.1.4.3:6 chip-ID: 0499:172f class-ID: 0103
  API: ALSA v: k6.8.0-41-generic status: kernel-api
  Server-1: PipeWire v: 1.0.5 status: active with: 1: pipewire-pulse status: active
    2: wireplumber status: active 3: pipewire-alsa type: plugin
Network:
  Device-1: Realtek RTL8852CE PCIe 802.11ax Wireless Network driver: rtw89_8852ce v: kernel pcie:
    speed: 5 GT/s lanes: 1 port: d000 bus-ID: 09:00.0 chip-ID: 10ec:c852 class-ID: 0280
  IF: wlp9s0 state: up mac: <filter>
  Device-2: Realtek RTL8125 2.5GbE vendor: Gigabyte driver: r8169 v: kernel pcie: speed: 5 GT/s
    lanes: 1 port: c000 bus-ID: 0a:00.0 chip-ID: 10ec:8125 class-ID: 0200
  IF: enp10s0 state: down mac: <filter>
  IF-ID-1: virbr0 state: up speed: 10000 Mbps duplex: unknown mac: <filter>
  IF-ID-2: vnet8 state: unknown speed: 10000 Mbps duplex: full mac: <filter>
Bluetooth:
  Device-1: Realtek Bluetooth Radio driver: btusb v: 0.8 type: USB rev: 1.0 speed: 12 Mb/s lanes: 1
    bus-ID: 1-6:3 chip-ID: 0bda:0852 class-ID: e001 serial: <filter>
  Report: hciconfig ID: hci0 rfk-id: 2 state: up address: <filter> bt-v: 5.3 lmp-v: 12
    sub-v: 7225 hci-v: 12 rev: 40d class-ID: 7c0104
Drives:
  Local Storage: total: 3.64 TiB used: 80.96 GiB (2.2%)
  ID-1: /dev/nvme0n1 vendor: Western Digital model: WD BLACK SN850X 4000GB size: 3.64 TiB
    speed: 63.2 Gb/s lanes: 4 tech: SSD serial: <filter> fw-rev: 624331WD temp: 40.9 C scheme: GPT
Partition:
  ID-1: / size: 3.58 TiB used: 80.96 GiB (2.2%) fs: ext4 dev: /dev/nvme0n1p2
  ID-2: /boot/efi size: 511 MiB used: 6.1 MiB (1.2%) fs: vfat dev: /dev/nvme0n1p1
Swap:
  ID-1: swap-1 type: file size: 2 GiB used: 256 KiB (0.0%) priority: -2 file: /swapfile
USB:
  Hub-1: 1-0:1 info: hi-speed hub with single TT ports: 12 rev: 2.0 speed: 480 Mb/s lanes: 1
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-2: 1-4:2 info: Realtek RTS5411 Hub ports: 4 rev: 2.1 speed: 480 Mb/s lanes: 1
    chip-ID: 0bda:5411 class-ID: 0900
  Hub-3: 1-4.1:4 info: VIA Labs Hub ports: 4 rev: 2.1 speed: 480 Mb/s lanes: 1 chip-ID: 2109:2811
    class-ID: 0900
  Hub-4: 1-4.1.3:6 info: VIA Labs Hub ports: 4 rev: 2.1 speed: 480 Mb/s lanes: 1
    chip-ID: 2109:2811 class-ID: 0900
  Device-1: 1-4.1.3.4:8 info: Areson Corp 2.4G Wireless Receiver type: keyboard,mouse
    driver: hid-generic,usbhid interfaces: 2 rev: 1.1 speed: 12 Mb/s lanes: 1 power: 100mA
    chip-ID: 25a7:fa11 class-ID: 0301
  Hub-5: 1-4.1.4:7 info: LG USA ASM107x ports: 4 rev: 2.1 speed: 480 Mb/s lanes: 1 power: 100mA
    chip-ID: 043e:9a10 class-ID: 0900
  Device-1: 1-4.1.4.1:9 info: Apple Aluminium Keyboard (ANSI) type: keyboard,mouse
    driver: apple,usbhid interfaces: 2 rev: 2.0 speed: 12 Mb/s lanes: 1 power: 100mA
    chip-ID: 05ac:024f class-ID: 0301
  Device-2: 1-4.1.4.4:10 info: Texas Instruments TUSB3410 Microcontroller type: <vendor specific>
    driver: ti_usb_3410_5052,ti_usb_3410_5052_1 interfaces: 1 rev: 1.1 speed: 12 Mb/s lanes: 1
    power: 100mA chip-ID: 0451:3410 class-ID: ff00 serial: <filter>
  Device-3: 1-6:3 info: Realtek Bluetooth Radio type: bluetooth driver: btusb interfaces: 2
    rev: 1.0 speed: 12 Mb/s lanes: 1 power: 500mA chip-ID: 0bda:0852 class-ID: e001 serial: <filter>
  Device-4: 1-7:5 info: Integrated Express RGB LED Controller type: HID
    driver: hid-generic,usbhid interfaces: 1 rev: 2.0 speed: 12 Mb/s lanes: 1 power: 100mA
    chip-ID: 048d:5702 class-ID: 0300
  Hub-6: 2-0:1 info: super-speed hub ports: 5 rev: 3.1 speed: 20 Gb/s lanes: 2 chip-ID: 1d6b:0003
    class-ID: 0900
  Hub-7: 2-4:2 info: Realtek Hub ports: 4 rev: 3.2 speed: 5 Gb/s lanes: 1 chip-ID: 0bda:0411
    class-ID: 0900
  Hub-8: 2-4.1:3 info: VIA Labs Hub ports: 4 rev: 3.0 speed: 5 Gb/s lanes: 1 chip-ID: 2109:8110
    class-ID: 0900
  Hub-9: 2-4.1.3:4 info: VIA Labs Hub ports: 4 rev: 3.0 speed: 5 Gb/s lanes: 1 chip-ID: 2109:8110
    class-ID: 0900
  Hub-10: 2-4.1.4:5 info: LG USA ASM107x ports: 4 rev: 3.0 speed: 5 Gb/s lanes: 1 power: 8mA
    chip-ID: 043e:9a11 class-ID: 0900
  Device-1: 2-4.1.4.3:6 info: Yamaha Steinberg UR22C type: audio driver: snd-usb-audio
    interfaces: 4 rev: 3.1 speed: 5 Gb/s lanes: 1 power: 496mA chip-ID: 0499:172f class-ID: 0103
  Hub-11: 3-0:1 info: hi-speed hub with single TT ports: 2 rev: 2.0 speed: 480 Mb/s lanes: 1
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-12: 4-0:1 info: super-speed hub ports: 2 rev: 3.1 speed: 10 Gb/s lanes: 1
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-13: 5-0:1 info: hi-speed hub with single TT ports: 2 rev: 2.0 speed: 480 Mb/s lanes: 1
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-14: 6-0:1 info: super-speed hub ports: 2 rev: 3.1 speed: 10 Gb/s lanes: 1
    chip-ID: 1d6b:0003 class-ID: 0900
  Hub-15: 7-0:1 info: hi-speed hub with single TT ports: 1 rev: 2.0 speed: 480 Mb/s lanes: 1
    chip-ID: 1d6b:0002 class-ID: 0900
  Hub-16: 7-1:2 info: Genesys Logic Hub ports: 4 rev: 2.0 speed: 480 Mb/s lanes: 1 power: 100mA
    chip-ID: 05e3:0608 class-ID: 0900
  Hub-17: 8-0:1 info: Linux Foundation 3.0 root hub ports: N/A rev: 3.0 speed: 5 Gb/s lanes: 1
    chip-ID: 1d6b:0003 class-ID: 0900
Sensors:
  System Temperatures: cpu: 65.2 C mobo: 34.0 C gpu: amdgpu temp: 39.0 C
  Fan Speeds (rpm): N/A
Repos:
  Packages: 2382 pm: dpkg pkgs: 2376 pm: flatpak pkgs: 6
  No active apt repos in: /etc/apt/sources.list
  Active apt repos in: /etc/apt/sources.list.d/official-package-repositories.list
    1: deb https: //mirrors.ocf.berkeley.edu/linuxmint-packages wilma main upstream import backport
    2: deb http: //archive.ubuntu.com/ubuntu noble main restricted universe multiverse
    3: deb http: //archive.ubuntu.com/ubuntu noble-updates main restricted universe multiverse
    4: deb http: //archive.ubuntu.com/ubuntu noble-backports main restricted universe multiverse
    5: deb http: //security.ubuntu.com/ubuntu/ noble-security main restricted universe multiverse
  Active apt repos in: /etc/apt/sources.list.d/vscode.list
    1: deb [arch=amd64,arm64,armhf] https: //packages.microsoft.com/repos/code stable main
Info:
  Memory: total: 64 GiB note: est. available: 61.91 GiB used: 10.93 GiB (17.7%)
  Processes: 547 Power: uptime: 4h 45m states: freeze,mem,disk suspend: deep wakeups: 1
    hibernate: platform Init: systemd v: 255 target: graphical (5) default: graphical
  Compilers: clang: 16 gcc: 13.2.0 Client: Unknown python3.12 client inxi: 3.3.34
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14d8
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14d8
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Device 14d9
	Subsystem: Gigabyte Technology Co., Ltd Device d000
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
	Kernel driver in use: pcieport
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
	Kernel driver in use: pcieport
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
00:02.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14db
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 1453
	Kernel driver in use: pcieport
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14da
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
	Kernel driver in use: pcieport
00:08.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 14dd
	Subsystem: Advanced Micro Devices, Inc. [AMD] Device 14dd
	Kernel driver in use: pcieport
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 71)
	Subsystem: Gigabyte Technology Co., Ltd FCH SMBus Controller
	Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
	Subsystem: Gigabyte Technology Co., Ltd FCH LPC Bridge
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e3
	Kernel driver in use: k10temp
	Kernel modules: k10temp
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 14e7
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev 10)
	Kernel driver in use: pcieport
02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch (rev 10)
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch
	Kernel driver in use: pcieport
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 [Radeon RX 7900 XT/7900 XTX/7900M] (rev c8)
	Subsystem: ASRock Incorporation Navi 31 [Radeon RX 7900 XT/7900 XTX]
	Kernel driver in use: vfio-pci
	Kernel modules: amdgpu
03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 31 HDMI/DP Audio
	Kernel driver in use: vfio-pci
	Kernel modules: snd_hda_intel
04:00.0 Non-Volatile memory controller: Sandisk Corp WD Black SN850X NVMe SSD (rev 01)
	Subsystem: Sandisk Corp WD Black SN850X NVMe SSD
	Kernel driver in use: nvme
	Kernel modules: nvme
05:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Upstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:0c.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
06:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset PCIe Switch Downstream Port (rev 01)
	Subsystem: ASMedia Technology Inc. Device 3328
	Kernel driver in use: pcieport
09:00.0 Network controller: Realtek Semiconductor Co., Ltd. RTL8852CE PCIe 802.11ax Wireless Network Controller (rev 01)
	Subsystem: Realtek Semiconductor Co., Ltd. RTL8852CE PCIe 802.11ax Wireless Network Controller
	Kernel driver in use: rtw89_8852ce
	Kernel modules: rtw89_8852ce
0a:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8125 2.5GbE Controller (rev 05)
	Subsystem: Gigabyte Technology Co., Ltd RTL8125 2.5GbE Controller
	Kernel driver in use: r8169
	Kernel modules: r8169
10:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset USB 3.2 Controller (rev 01)
	Subsystem: ASMedia Technology Inc. Device 1142
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci
11:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] 600 Series Chipset SATA Controller (rev 01)
	Subsystem: ASMedia Technology Inc. Device 1062
	Kernel driver in use: ahci
	Kernel modules: ahci
12:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Raphael (rev c1)
	Subsystem: Gigabyte Technology Co., Ltd Raphael
	Kernel driver in use: amdgpu
	Kernel modules: amdgpu
12:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel
12:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 19h PSP/CCP
	Kernel driver in use: ccp
	Kernel modules: ccp
12:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b6
	Subsystem: Gigabyte Technology Co., Ltd Device 5007
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci
12:00.4 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b7
	Subsystem: Gigabyte Technology Co., Ltd Device 5007
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci
12:00.6 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller
	DeviceName: Realtek ALC1220
	Subsystem: Gigabyte Technology Co., Ltd Family 17h/19h HD Audio Controller
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel
13:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 15b8
	Subsystem: Gigabyte Technology Co., Ltd Device 5007
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci
2 Likes