VFIO Pass through working on 9070XT

BuzzBumbleBee · March 8, 2025, 9:47am

So I just got my 9070XT installed and pcie pass through is working as expected, it also can survive the VM rebooting.

Video attached as proof, I’ll be posting more information on my setup later today for anyone that’s interested

FYI @wendell unsure if you have done much tests of this card in a VM but it seems pretty much the same as my older 6800XT

Update : adding more info on my setup

Kernel : 6.13.3-arch1-1

Linux Firmware version : linux-firmware-git 20250307.bd3d8a8b-1

Mesa Info :

Extended renderer info (GLX_MESA_query_renderer):
    Vendor: AMD (0x1002)
    Device: AMD Radeon Graphics (radeonsi, gfx1201, ACO, DRM 3.60, 6.13.3-arch1-1) (0x7550)
    Version: 25.0.1
    Accelerated: yes
    Video memory: 16384MB
    Unified memory: no
    Preferred profile: core (0x1)
    Max core profile version: 4.6
    Max compat profile version: 4.6
    Max GLES1 profile version: 1.1
    Max GLES[23] profile version: 3.2

Qemu version : 9.1.0-2

Kernel logs with the unbind / rebind

[   13.126822] fbcon: amdgpudrmfb (fb0) is primary device
[   13.126924] [drm] pre_validate_dsc:1600 MST_DSC dsc precompute is not needed
[   13.390628] amdgpu 0000:59:00.0: [drm] REG_WAIT timeout 1us * 100000 tries - optc31_disable_crtc line:145
[   13.422942] Console: switching to colour frame buffer device 160x45
[   13.441855] amdgpu 0000:59:00.0: [drm] fb0: amdgpudrmfb frame buffer device
[   13.759254] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[   13.759257] Bluetooth: BNEP filters: protocol multicast
[   13.759259] Bluetooth: BNEP socket layer initialized
[   13.760235] Bluetooth: MGMT ver 1.23
[   13.763416] NET: Registered PF_ALG protocol family
[   13.993371] Realtek Internal NBASE-T PHY r8169-0-4a00:00: attached PHY driver (mii_bus:phy_addr=r8169-0-4a00:00, irq=MAC)
[   14.118529] r8169 0000:4a:00.0 enp74s0: Link is Down
[   14.282581] iwlwifi 0000:49:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x20
[   14.282603] iwlwifi 0000:49:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x1f
[   14.282615] iwlwifi 0000:49:00.0: WFPM_AUTH_KEY_0: 0x90
[   14.282630] iwlwifi 0000:49:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x0
[   14.372496] iwlwifi 0000:49:00.0: Registered PHC clock: iwlwifi-PTP, with index: 0
[   14.571830] iwlwifi 0000:49:00.0: WFPM_UMAC_PD_NOTIFICATION: 0x20
[   14.571851] iwlwifi 0000:49:00.0: WFPM_LMAC2_PD_NOTIFICATION: 0x1f
[   14.571863] iwlwifi 0000:49:00.0: WFPM_AUTH_KEY_0: 0x90
[   14.571875] iwlwifi 0000:49:00.0: CNVI_SCU_SEQ_DATA_DW9: 0x0
[   14.785327] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[   14.882614] u32 classifier
[   14.882616]     Performance counters on
[   14.882617]     input device check on
[   14.882618]     Actions configured
[   15.313352] r8169 0000:4a:00.0: invalid VPD tag 0x00 (size 0) at offset 0; assume missing optional EEPROM
[   16.249768] rfkill: input handler disabled
[   17.222726] r8169 0000:4a:00.0 enp74s0: Link is Up - 2.5Gbps/Full - flow control rx/tx
[   17.223451] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[   17.223467] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[   17.596090] Bluetooth: RFCOMM TTY layer initialized
[   17.596099] Bluetooth: RFCOMM socket layer initialized
[   17.596101] Bluetooth: RFCOMM ver 1.11
[   18.151077] wlp73s0: authenticate with 00:0c:43:26:60:00 (local address=e8:f4:08:d8:a2:7f)
[   18.152090] wlp73s0: send auth to 00:0c:43:26:60:00 (try 1/3)
[   18.182550] wlp73s0: authenticated
[   18.183353] wlp73s0: associate with 00:0c:43:26:60:00 (try 1/3)
[   18.193072] wlp73s0: RX AssocResp from 00:0c:43:26:60:00 (capab=0x1431 status=0 aid=3)
[   18.198609] wlp73s0: associated
[   18.244856] wlp73s0: Limiting TX power to 20 (20 - 0) dBm as advertised by 00:0c:43:26:60:00
[   19.154009] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[   19.154061] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[   20.447412] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[   20.866517] Initializing XFRM netlink socket
[   21.610409] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[   21.615969] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[   21.621757] systemd-journald[847]: Fixed min_use=3.5G max_use=4G max_size=128M min_size=512K keep_free=4G n_max_files=100
[   22.046856] rfkill: input handler enabled
[  104.144353] systemd-journald[847]: Sent WATCHDOG=1 notification.
[  191.026089] systemd-journald[847]: Sent WATCHDOG=1 notification.
[  255.377061] amdgpu 0000:03:00.0: amdgpu: amdgpu: finishing device.
[  255.377563] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  255.377578] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  255.442062] [drm] amdgpu: ttm finalized
[  257.444628] pci 0000:03:00.0: BAR 0 [mem 0xf800000000-0xfbffffffff 64bit pref]: releasing
[  257.444635] pci 0000:03:00.0: BAR 2 [mem 0xfc00000000-0xfc0fffffff 64bit pref]: releasing
[  257.444651] pcieport 0000:02:00.0: bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]: releasing
[  257.444654] pcieport 0000:01:00.0: bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]: releasing
[  257.444655] pcieport 0000:00:01.1: bridge window [mem 0xf800000000-0xfc0fffffff 64bit pref]: releasing
[  257.444663] pcieport 0000:00:01.1: bridge window [mem 0xa00000000-0xfffffffff 64bit pref]: assigned
[  257.444666] pcieport 0000:01:00.0: bridge window [mem 0xa00000000-0xfffffffff 64bit pref]: assigned
[  257.444668] pcieport 0000:02:00.0: bridge window [mem 0xa00000000-0xfffffffff 64bit pref]: assigned
[  257.444670] pci 0000:03:00.0: BAR 0 [mem 0xc00000000-0xfffffffff 64bit pref]: assigned
[  257.444679] pci 0000:03:00.0: BAR 2 [mem 0xa00000000-0xa007fffff 64bit pref]: assigned
[  257.444686] pcieport 0000:00:01.1: PCI bridge to [bus 01-03]
[  257.444688] pcieport 0000:00:01.1:   bridge window [io  0xf000-0xffff]
[  257.444692] pcieport 0000:00:01.1:   bridge window [mem 0xef000000-0xef1fffff]
[  257.444694] pcieport 0000:00:01.1:   bridge window [mem 0xa00000000-0xfffffffff 64bit pref]
[  257.444704] pcieport 0000:01:00.0: PCI bridge to [bus 02-03]
[  257.444707] pcieport 0000:01:00.0:   bridge window [io  0xf000-0xffff]
[  257.444711] pcieport 0000:01:00.0:   bridge window [mem 0xef000000-0xef0fffff]
[  257.444714] pcieport 0000:01:00.0:   bridge window [mem 0xa00000000-0xfffffffff 64bit pref]
[  257.444718] pcieport 0000:02:00.0: PCI bridge to [bus 03]
[  257.444720] pcieport 0000:02:00.0:   bridge window [io  0xf000-0xffff]
[  257.444723] pcieport 0000:02:00.0:   bridge window [mem 0xef000000-0xef0fffff]
[  257.444726] pcieport 0000:02:00.0:   bridge window [mem 0xa00000000-0xfffffffff 64bit pref]
[  270.386597] rfkill: input handler disabled
[  290.353115] xhci_hcd 0000:59:00.3: remove, state 4
[  290.353121] usb usb8: USB disconnect, device number 1
[  290.353291] xhci_hcd 0000:59:00.3: USB bus 8 deregistered
[  290.353297] xhci_hcd 0000:59:00.3: remove, state 4
[  290.353300] usb usb7: USB disconnect, device number 1
[  290.353411] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  290.353430] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  290.353647] xhci_hcd 0000:59:00.3: USB bus 7 deregistered
[  290.353779] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:896".
[  290.353844] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  290.353857] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  290.353947] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  290.353960] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  290.354003] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:768".
[  290.354098] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  290.354111] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  290.391106] xhci_hcd 0000:59:00.4: remove, state 4
[  290.391110] usb usb10: USB disconnect, device number 1
[  290.391257] xhci_hcd 0000:59:00.4: USB bus 10 deregistered
[  290.391265] xhci_hcd 0000:59:00.4: remove, state 4
[  290.391267] usb usb9: USB disconnect, device number 1
[  290.391450] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  290.391476] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  290.391607] xhci_hcd 0000:59:00.4: USB bus 9 deregistered
[  290.391756] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:1152".
[  290.391872] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  290.391894] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  290.392033] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  290.392056] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  290.392130] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:1024".
[  290.392351] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  290.392392] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  290.392818] r8169 0000:4a:00.0 enp74s0: Link is Down
[  290.393409] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  290.393442] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  290.436629] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[  290.437114] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem:owns=none
[  290.437402] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  290.437421] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  290.705431] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[  290.744994] tun: Universal TUN/TAP device driver, 1.6
[  290.745499] virbr1: port 1(vnet0) entered blocking state
[  290.745518] virbr1: port 1(vnet0) entered disabled state
[  290.745527] vnet0: entered allmulticast mode
[  290.745565] vnet0: entered promiscuous mode
[  290.746542] virbr1: port 1(vnet0) entered blocking state
[  290.746545] virbr1: port 1(vnet0) entered listening state
[  291.510212] vfio-pci 0000:58:00.0: resetting
[  291.510429] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:58:00.0".
[  291.510454] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:58:00.0".
[  291.614310] vfio-pci 0000:58:00.0: reset done
[  291.614638] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:58:00.0".
[  291.614660] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:58:00.0".
[  291.630692] vfio-pci 0000:59:00.3: resetting
[  291.631367] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  291.631392] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  291.654260] vfio-pci 0000:59:00.3: reset done
[  291.654397] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  291.654411] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  291.666310] vfio-pci 0000:59:00.4: resetting
[  291.667361] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  291.667386] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  291.690387] vfio-pci 0000:59:00.4: reset done
[  291.690623] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  291.690647] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  291.866850] vfio-pci 0000:4a:00.0: resetting
[  291.866938] pcieport 0000:46:06.0: unlocked secondary bus reset via: __pci_reset_function_locked+0x3e/0x70
[  291.867424] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  291.867450] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  291.998355] vfio-pci 0000:4a:00.0: reset done
[  291.998566] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:46:06.0".
[  291.998580] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:46:06.0".
[  291.998707] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  291.998719] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  292.001192] vfio-pci 0000:03:00.0: resetting
[  292.001290] vfio-pci 0000:03:00.0: reset done
[  292.001337] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  292.001369] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  292.001575] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  292.001605] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  292.024212] vfio-pci 0000:03:00.0: resetting
[  292.024264] vfio-pci 0000:03:00.1: resetting
[  292.024296] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  292.024310] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  292.150570] vfio-pci 0000:03:00.0: reset done
[  292.150608] vfio-pci 0000:03:00.1: reset done
[  292.150906] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.1".
[  292.150939] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.1".
[  292.151143] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  292.151165] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  292.151174] vfio-pci 0000:4a:00.0: resetting
[  292.151325] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.1".
[  292.151347] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.1".
[  292.151589] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  292.151619] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  292.278338] vfio-pci 0000:4a:00.0: reset done
[  292.278625] vfio-pci 0000:59:00.4: resetting
[  292.278717] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  292.278741] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  292.278887] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  292.278909] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  292.302229] vfio-pci 0000:59:00.4: reset done
[  292.302350] vfio-pci 0000:59:00.3: resetting
[  292.302398] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  292.302411] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  292.302498] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  292.302510] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  292.326233] vfio-pci 0000:59:00.3: reset done
[  292.326327] vfio-pci 0000:58:00.0: resetting
[  292.326484] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  292.326509] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  292.326663] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:58:00.0".
[  292.326685] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:58:00.0".
[  292.430250] vfio-pci 0000:58:00.0: reset done
[  292.430496] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:58:00.0".
[  292.430517] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:58:00.0".
[  292.798198] virbr1: port 1(vnet0) entered learning state
[  294.847115] virbr1: port 1(vnet0) entered forwarding state
[  294.847119] virbr1: topology change detected, propagating
[  295.331350] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[  311.700122] usb 5-8: reset high-speed USB device number 3 using xhci_hcd
[  320.307008] usb 3-3: USB disconnect, device number 2
[  320.307014] usb 3-3.1: USB disconnect, device number 3
[  320.694276] usb 4-3: USB disconnect, device number 2
[  320.727525] usb 3-3.3: USB disconnect, device number 4
[  320.739276] systemd[1]: Received SIGCHLD from PID 6980 ((sd-close)).
[  320.751268] systemd[1]: Child 6980 ((sd-close)) died (code=exited, status=0/SUCCESS)
[  320.763271] systemd[1]: init.scope: Child 6980 belongs to init.scope.
[  320.893269] systemd[1]: systemd-logind.service: Received EPOLLERR on stored fd 228 (session-8-device-13-73), closing.
[  320.899218] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:258".
[  320.899322] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:385".
[  320.899405] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/dev/char/189:259".
[  364.472336] xhci_hcd 0000:54:00.0: xHC error in resume, USBSTS 0x401, Reinit
[  364.472340] usb usb3: root hub lost power or was reset
[  364.472341] usb usb4: root hub lost power or was reset
[  364.528289] pcieport 0000:00:02.1: PME: Spurious native interrupt!
[  364.528427] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:54:00.0".
[  364.528445] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:54:00.0".
[  364.528937] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:00:02.1".
[  364.528952] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:00:02.1".
[  364.829197] usb 3-3: new high-speed USB device number 5 using xhci_hcd
[  364.830245] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/bus/usb/devices/3-3".
[  364.830263] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/3-3".
[  364.830277] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/3-3".
[  365.049171] usb 3-3: New USB device found, idVendor=05e3, idProduct=0610, bcdDevice= 6.54
[  365.049176] usb 3-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[  365.049179] usb 3-3: Product: USB2.1 Hub
[  365.049186] usb 3-3: Manufacturer: GenesysLogic
[  365.057190] hub 3-3:1.0: USB hub found
[  365.061159] hub 3-3:1.0: 4 ports detected
[  365.081880] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/3-3:1.0".
[  365.081905] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/3-3:1.0".
[  365.082071] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/3-3:1.0".
[  365.082085] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/3-3:1.0".
[  365.144978] usb 4-3: new SuperSpeed USB device number 3 using xhci_hcd
[  365.145254] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/bus/usb/devices/4-3".
[  365.145280] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/4-3".
[  365.145303] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/4-3".
[  365.160153] usb 4-3: New USB device found, idVendor=05e3, idProduct=0626, bcdDevice= 6.54
[  365.160155] usb 4-3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[  365.160157] usb 4-3: Product: USB3.1 Hub
[  365.160158] usb 4-3: Manufacturer: GenesysLogic
[  365.166461] hub 4-3:1.0: USB hub found
[  365.166744] hub 4-3:1.0: 4 ports detected
[  365.168299] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/4-3:1.0".
[  365.168313] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/4-3:1.0".
[  365.168406] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/4-3:1.0".
[  365.168419] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/4-3:1.0".
[  365.416182] usb 3-3.1: new full-speed USB device number 6 using xhci_hcd
[  365.417252] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/bus/usb/devices/3-3.1".
[  365.417278] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/3-3.1".
[  365.417301] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/3-3.1".
[  365.744175] usb 3-3.1: New USB device found, idVendor=b333, idProduct=b55b, bcdDevice= 0.01
[  365.744181] usb 3-3.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[  365.744184] usb 3-3.1: Product: 65f_072
[  365.744186] usb 3-3.1: Manufacturer: buzzbumblebee
[  365.744188] usb 3-3.1: SerialNumber: 340021001853524E3536322000000000
[  365.779364] input: buzzbumblebee 65f_072 as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.1/3-3.1:1.0/0003:B333:B55B.0008/input/input20
[  365.899244] hid-generic 0003:B333:B55B.0008: input,hidraw1: USB HID v1.11 Keyboard [buzzbumblebee 65f_072] on usb-0000:54:00.0-3.1/input0
[  365.921303] input: buzzbumblebee 65f_072 Mouse as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.1/3-3.1:1.1/0003:B333:B55B.0009/input/input21
[  365.972191] input: buzzbumblebee 65f_072 System Control as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.1/3-3.1:1.1/0003:B333:B55B.0009/input/input22
[  365.972265] input: buzzbumblebee 65f_072 Consumer Control as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.1/3-3.1:1.1/0003:B333:B55B.0009/input/input23
[  365.972312] input: buzzbumblebee 65f_072 Keyboard as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.1/3-3.1:1.1/0003:B333:B55B.0009/input/input24
[  366.037307] hid-generic 0003:B333:B55B.0009: input,hidraw2: USB HID v1.11 Mouse [buzzbumblebee 65f_072] on usb-0000:54:00.0-3.1/input1
[  366.038112] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:B333:B55B.0008".
[  366.038127] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:B333:B55B.0008".
[  366.038283] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:B333:B55B.0009".
[  366.038296] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:B333:B55B.0009".
[  366.140166] usb 3-3.3: new full-speed USB device number 7 using xhci_hcd
[  366.141233] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/bus/usb/devices/3-3.3".
[  366.141259] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/3-3.3".
[  366.141282] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/3-3.3".
[  366.463170] usb 3-3.3: New USB device found, idVendor=046d, idProduct=c547, bcdDevice= 4.02
[  366.463173] usb 3-3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[  366.463175] usb 3-3.3: Product: USB Receiver
[  366.463176] usb 3-3.3: Manufacturer: Logitech
[  366.503299] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.3/3-3.3:1.0/0003:046D:C547.000A/input/input25
[  366.555235] hid-generic 0003:046D:C547.000A: input,hidraw3: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:54:00.0-3.3/input0
[  366.569392] input: Logitech USB Receiver Keyboard as /devices/pci0000:00/0000:00:02.1/0000:45:00.0/0000:46:08.0/0000:4c:00.0/0000:4d:0c.0/0000:54:00.0/usb3/3-3/3-3.3/3-3.3:1.1/0003:046D:C547.000B/input/input26
[  366.682260] hid-generic 0003:046D:C547.000B: input,hidraw4: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:54:00.0-3.3/input1
[  366.692293] hid-generic 0003:046D:C547.000C: hiddev96,hidraw5: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:54:00.0-3.3/input2
[  366.693225] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:046D:C547.000A".
[  366.693239] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:046D:C547.000A".
[  366.693366] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:046D:C547.000B".
[  366.693379] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:046D:C547.000B".
[  366.693482] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:046D:C547.000C".
[  366.693494] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:046D:C547.000C".
[  366.702809] systemd-journald[847]: Compressed data object 580 -> 353 using ZSTD
[  366.710300] systemd-journald[847]: Compressed data object 687 -> 408 using ZSTD
[  370.454486] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[  373.771688] systemd-journald[847]: Sent WATCHDOG=1 notification.
[  375.782080] virbr1: port 1(vnet0) entered disabled state
[  375.782192] vnet0 (unregistering): left allmulticast mode
[  375.782196] vnet0 (unregistering): left promiscuous mode
[  375.782198] virbr1: port 1(vnet0) entered disabled state
[  375.804094] systemd-journald[847]: Successfully sent stream file descriptor to service manager.
[  375.970548] usb 5-8: reset high-speed USB device number 3 using xhci_hcd
[  381.155162] hid-generic 0003:26CE:0A06.000D: hiddev97,hidraw6: USB HID v1.11 Device [Generic USB Audio] on usb-0000:56:00.0-8/input6
[  381.156002] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/hid/0003:26CE:0A06.000D".
[  381.156017] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/hid/0003:26CE:0A06.000D".
[  381.167655] vfio-pci 0000:03:00.0: resetting
[  381.167696] vfio-pci 0000:03:00.1: resetting
[  381.167999] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  381.168025] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  381.291942] vfio-pci 0000:03:00.0: reset done
[  381.291977] vfio-pci 0000:03:00.1: reset done
[  381.292193] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.1".
[  381.292208] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.1".
[  381.292334] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  381.292347] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  381.292432] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.1".
[  381.292445] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.1".
[  381.989579] nvme nvme1: pci function 0000:58:00.0
[  382.026807] nvme nvme1: 31/0/0 default/read/poll queues
[  382.030768]  nvme1n1: p1 p2 p3 p4 p5
[  382.067147] xhci_hcd 0000:59:00.3: xHCI Host Controller
[  382.067152] xhci_hcd 0000:59:00.3: new USB bus registered, assigned bus number 7
[  382.067510] xhci_hcd 0000:59:00.3: hcc params 0x0120ffc5 hci version 0x120 quirks 0x0000000200000010
[  382.067800] xhci_hcd 0000:59:00.3: xHCI Host Controller
[  382.067805] xhci_hcd 0000:59:00.3: new USB bus registered, assigned bus number 8
[  382.067809] xhci_hcd 0000:59:00.3: Host supports USB 3.1 Enhanced SuperSpeed
[  382.067877] usb usb7: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.13
[  382.067882] usb usb7: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[  382.067884] usb usb7: Product: xHCI Host Controller
[  382.067886] usb usb7: Manufacturer: Linux 6.13.3-arch1-1 xhci-hcd
[  382.067888] usb usb7: SerialNumber: 0000:59:00.3
[  382.068006] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.068038] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.068055] hub 7-0:1.0: USB hub found
[  382.068074] hub 7-0:1.0: 2 ports detected
[  382.069327] usb usb8: We don't know the algorithms for LPM for this host, disabling LPM.
[  382.069345] usb usb8: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.13
[  382.069347] usb usb8: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[  382.069348] usb usb8: Product: xHCI Host Controller
[  382.069349] usb usb8: Manufacturer: Linux 6.13.3-arch1-1 xhci-hcd
[  382.069350] usb usb8: SerialNumber: 0000:59:00.3
[  382.069437] hub 8-0:1.0: USB hub found
[  382.069446] hub 8-0:1.0: 2 ports detected
[  382.070760] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.070774] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.070866] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.070881] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.070975] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.070988] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.071062] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.071075] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.071161] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.3".
[  382.071174] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.3".
[  382.071792] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/7-0:1.0".
[  382.071806] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/7-0:1.0".
[  382.071902] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/7-0:1.0".
[  382.071915] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/7-0:1.0".
[  382.072017] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/usb8".
[  382.072030] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/usb8".
[  382.072558] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/8-0:1.0".
[  382.072571] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/8-0:1.0".
[  382.072660] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/8-0:1.0".
[  382.072673] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/8-0:1.0".
[  382.106048] xhci_hcd 0000:59:00.4: xHCI Host Controller
[  382.106053] xhci_hcd 0000:59:00.4: new USB bus registered, assigned bus number 9
[  382.106404] xhci_hcd 0000:59:00.4: hcc params 0x0120ffc5 hci version 0x120 quirks 0x0000000200000010
[  382.106881] xhci_hcd 0000:59:00.4: xHCI Host Controller
[  382.106884] xhci_hcd 0000:59:00.4: new USB bus registered, assigned bus number 10
[  382.106886] xhci_hcd 0000:59:00.4: Host supports USB 3.1 Enhanced SuperSpeed
[  382.106914] usb usb9: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.13
[  382.106916] usb usb9: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[  382.106917] usb usb9: Product: xHCI Host Controller
[  382.106918] usb usb9: Manufacturer: Linux 6.13.3-arch1-1 xhci-hcd
[  382.106919] usb usb9: SerialNumber: 0000:59:00.4
[  382.106948] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.106966] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.107002] hub 9-0:1.0: USB hub found
[  382.107011] hub 9-0:1.0: 2 ports detected
[  382.108201] usb usb10: We don't know the algorithms for LPM for this host, disabling LPM.
[  382.108220] usb usb10: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.13
[  382.108221] usb usb10: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[  382.108223] usb usb10: Product: xHCI Host Controller
[  382.108224] usb usb10: Manufacturer: Linux 6.13.3-arch1-1 xhci-hcd
[  382.108225] usb usb10: SerialNumber: 0000:59:00.4
[  382.108291] hub 10-0:1.0: USB hub found
[  382.108300] hub 10-0:1.0: 2 ports detected
[  382.109628] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.109646] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.109753] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.109769] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.109882] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.109899] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.110006] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.110022] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.110115] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:59:00.4".
[  382.110128] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:59:00.4".
[  382.110692] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/9-0:1.0".
[  382.110706] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/9-0:1.0".
[  382.110798] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/9-0:1.0".
[  382.110811] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/9-0:1.0".
[  382.110914] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/usb10".
[  382.110930] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/usb10".
[  382.111501] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/10-0:1.0".
[  382.111514] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/10-0:1.0".
[  382.111600] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/usb/10-0:1.0".
[  382.111613] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/usb/10-0:1.0".
[  382.286850] r8169 0000:4a:00.0 eth0: RTL8125B, a8:a1:59:e8:2c:0a, XID 641, IRQ 171
[  382.286855] r8169 0000:4a:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko]
[  382.287008] vfio-pci 0000:03:00.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem:owns=none
[  382.287396] [drm] initializing kernel modesetting (IP DISCOVERY 0x1002:0x7550 0x148C:0x2435 0xC0).
[  382.287408] [drm] register mmio base: 0xEF000000
[  382.287409] [drm] register mmio size: 524288
[  382.287928] r8169 0000:4a:00.0 enp74s0: renamed from eth0
[  382.288927] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  382.288944] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  382.289065] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:4a:00.0".
[  382.289081] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:4a:00.0".
[  382.289193] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/class/pci/0000:03:00.0".
[  382.289210] systemd-journald[847]: sd-device: Failed to chase symlinks in "/sys/firmware/pci/0000:03:00.0".
[  382.290654] [drm] add ip block number 0 <soc24_common>
[  382.290656] [drm] add ip block number 1 <gmc_v12_0>
[  382.290657] [drm] add ip block number 2 <ih_v7_0>
[  382.290659] [drm] add ip block number 3 <psp>
[  382.290660] [drm] add ip block number 4 <smu>
[  382.290660] [drm] add ip block number 5 <dm>
[  382.290662] [drm] add ip block number 6 <gfx_v12_0>
[  382.290663] [drm] add ip block number 7 <sdma_v7_0>
[  382.290664] [drm] add ip block number 8 <vcn_v5_0_0>
[  382.290665] [drm] add ip block number 9 <jpeg_v5_0_0>
[  382.290665] [drm] add ip block number 10 <mes_v12_0>
[  382.290686] amdgpu 0000:03:00.0: amdgpu: Fetched VBIOS from VFCT
[  382.290688] amdgpu: ATOM BIOS: 113-EXT109020-100
[  382.295658] amdgpu 0000:03:00.0: amdgpu: Trusted Memory Zone (TMZ) feature not supported
[  382.295989] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[  382.295996] amdgpu 0000:03:00.0: amdgpu: VRAM: 16304M 0x0000008000000000 - 0x00000083FAFFFFFF (16304M used)
[  382.295998] amdgpu 0000:03:00.0: amdgpu: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
[  382.296005] [drm] Detected VRAM RAM=16304M, BAR=16384M
[  382.296007] [drm] RAM width 256bits GDDR6
[  382.296081] [drm] amdgpu: 16304M of VRAM memory ready
[  382.296082] [drm] amdgpu: 15598M of GTT memory ready.
[  382.296095] [drm] GART: num cpu pages 131072, num gpu pages 131072
[  382.296139] amdgpu 0000:03:00.0: amdgpu: PCIE GART of 512M enabled (table at 0x00000083DAB00000).
[  382.296514] [drm] Loading DMUB firmware via PSP: version=0x0000FF00
[  382.314858] Realtek Internal NBASE-T PHY r8169-0-4a00:00: attached PHY driver (mii_bus:phy_addr=r8169-0-4a00:00, irq=MAC)
[  382.348430] [drm] Found VCN firmware Version ENC: 1.6 DEC: 9 VEP: 0 Revision: 20
[  382.473073] r8169 0000:4a:00.0 enp74s0: Link is Down
[  382.575380] amdgpu 0000:03:00.0: amdgpu: RAP: optional rap ta ucode is not available
[  382.575382] amdgpu 0000:03:00.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
[  382.575412] amdgpu 0000:03:00.0: amdgpu: smu driver if version = 0x0000002e, smu fw if version = 0x00000031, smu fw program = 0, smu fw version = 0x00683e00 (104.62.0)
[  382.575414] amdgpu 0000:03:00.0: amdgpu: SMU driver if version not matched
[  382.600996] amdgpu 0000:03:00.0: amdgpu: SMU is initialized successfully!
[  382.601504] [drm] Display Core v3.2.310 initialized on DCN 4.0.1
[  382.601506] [drm] DP-HDMI FRL PCON supported
[  382.605107] [drm] DMUB hardware initialized: version=0x0000FF00
[  382.834032] amdgpu: HMM registered 16304MB device memory
[  382.834580] kfd kfd: amdgpu: Allocated 3969056 bytes on gart
[  382.834600] kfd kfd: amdgpu: Total number of KFD nodes to be created: 1
[  382.834631] amdgpu: Virtual CRAT table created for GPU
[  382.834787] amdgpu: Topology: Add dGPU node [0x7550:0x1002]
[  382.834789] kfd kfd: amdgpu: added device 1002:7550
[  382.834796] amdgpu 0000:03:00.0: amdgpu: SE 4, SH per SE 2, CU per SH 8, active_cu_number 64
[  382.834799] amdgpu 0000:03:00.0: amdgpu: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
[  382.834801] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[  382.834802] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[  382.834803] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.1 uses VM inv eng 6 on hub 0
[  382.834804] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.1 uses VM inv eng 7 on hub 0
[  382.834805] amdgpu 0000:03:00.0: amdgpu: ring sdma0 uses VM inv eng 8 on hub 0
[  382.834806] amdgpu 0000:03:00.0: amdgpu: ring sdma1 uses VM inv eng 9 on hub 0
[  382.834807] amdgpu 0000:03:00.0: amdgpu: ring vcn_unified_0 uses VM inv eng 0 on hub 8
[  382.834808] amdgpu 0000:03:00.0: amdgpu: ring jpeg_dec uses VM inv eng 1 on hub 8
[  382.837803] [drm] ring gfx_32768.1.1 was added
[  382.837973] [drm] ring compute_32768.2.2 was added
[  382.838136] [drm] ring sdma_32768.3.3 was added
[  382.838165] [drm] ring gfx_32768.1.1 ib test pass
[  382.838206] [drm] ring compute_32768.2.2 ib test pass
[  382.838240] [drm] ring sdma_32768.3.3 ib test pass
[  382.840901] amdgpu 0000:03:00.0: amdgpu: Using BACO for runtime pm
[  382.841385] [drm] Initialized amdgpu 3.60.0 for 0000:03:00.0 on minor 0

Startup process :

drop to shell (ctrl-alt f4)
stop display manager (systemctl stop gdm)
unbind amdgpu (unbind.sh below)
start display manager (systemctl start gdm)
you can launch the VM via libvirt / vm manager

unbind.sh

#!/bin/bash

echo "0000:03:00.0" > /sys/bus/pci/drivers/amdgpu/unbind
sleep 2
echo 3 > /sys/bus/pci/devices/0000:03:00.0/resource2_resize
sleep 2

System info

CPU : AMD 7950X
Mobo: ASRock X670E Tiahci (bios has the normal SVM and IOMMU stuff enabled plus resizable bar)

VM XML

<domain xmlns:qemu="http://libvirt.org/schemas/domain/qemu/1.0" type="kvm">
  <name>win10</name>
  <uuid>46ffa3bb-a63e-42c7-8e24-d49593d5b8b9</uuid>
  <metadata>
    <libosinfo:libosinfo xmlns:libosinfo="http://libosinfo.org/xmlns/libvirt/domain/1.0">
      <libosinfo:os id="http://microsoft.com/win/10"/>
    </libosinfo:libosinfo>
  </metadata>
  <memory unit="KiB">14336000</memory>
  <currentMemory unit="KiB">13312</currentMemory>
  <vcpu placement="static">16</vcpu>
  <iothreads>1</iothreads>
  <cputune>
    <vcpupin vcpu="0" cpuset="8"/>
    <vcpupin vcpu="1" cpuset="24"/>
    <vcpupin vcpu="2" cpuset="9"/>
    <vcpupin vcpu="3" cpuset="25"/>
    <vcpupin vcpu="4" cpuset="10"/>
    <vcpupin vcpu="5" cpuset="26"/>
    <vcpupin vcpu="6" cpuset="11"/>
    <vcpupin vcpu="7" cpuset="27"/>
    <vcpupin vcpu="8" cpuset="12"/>
    <vcpupin vcpu="9" cpuset="28"/>
    <vcpupin vcpu="10" cpuset="13"/>
    <vcpupin vcpu="11" cpuset="29"/>
    <vcpupin vcpu="12" cpuset="14"/>
    <vcpupin vcpu="13" cpuset="30"/>
    <vcpupin vcpu="14" cpuset="15"/>
    <vcpupin vcpu="15" cpuset="31"/>
    <emulatorpin cpuset="0,4"/>
    <iothreadpin iothread="1" cpuset="0,4"/>
  </cputune>
  <os firmware="efi">
    <type arch="x86_64" machine="pc-q35-9.1">hvm</type>
    <firmware>
      <feature enabled="no" name="enrolled-keys"/>
      <feature enabled="yes" name="secure-boot"/>
    </firmware>
    <loader readonly="yes" secure="yes" type="pflash" format="raw">/usr/share/edk2/x64/OVMF_CODE.secboot.4m.fd</loader>
    <nvram template="/usr/share/edk2/x64/OVMF_VARS.4m.fd" templateFormat="raw" format="raw">/var/lib/libvirt/qemu/win10_VARS.fd</nvram>
    <boot dev="hd"/>
    <bootmenu enable="yes"/>
    <smbios mode="host"/>
  </os>
  <features>
    <acpi/>
    <apic/>
    <hyperv mode="custom">
      <relaxed state="on"/>
      <vapic state="on"/>
      <spinlocks state="on" retries="8191"/>
      <vpindex state="on"/>
      <runtime state="on"/>
      <synic state="on"/>
      <stimer state="on"/>
      <vendor_id state="on" value="myv3nd0r1d"/>
      <frequencies state="on"/>
      <tlbflush state="on"/>
      <ipi state="on"/>
      <avic state="on"/>
    </hyperv>
    <kvm>
      <hidden state="on"/>
    </kvm>
    <vmport state="off"/>
    <smm state="on"/>
  </features>
  <cpu mode="host-passthrough" check="none" migratable="on">
    <topology sockets="1" dies="1" clusters="1" cores="8" threads="2"/>
    <feature policy="require" name="topoext"/>
  </cpu>
  <clock offset="localtime">
    <timer name="rtc" tickpolicy="catchup"/>
    <timer name="pit" present="yes" tickpolicy="discard"/>
    <timer name="hpet" present="no"/>
    <timer name="hypervclock" present="yes"/>
    <timer name="tsc" present="yes" mode="native"/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <pm>
    <suspend-to-mem enabled="no"/>
    <suspend-to-disk enabled="no"/>
  </pm>
  <devices>
    <emulator>/usr/bin/qemu-system-x86_64</emulator>
    <controller type="usb" index="0" model="qemu-xhci" ports="15">
      <address type="pci" domain="0x0000" bus="0x02" slot="0x00" function="0x0"/>
    </controller>
    <controller type="pci" index="0" model="pcie-root"/>
    <controller type="pci" index="1" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="1" port="0x10"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x0" multifunction="on"/>
    </controller>
    <controller type="pci" index="2" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="2" port="0x11"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x1"/>
    </controller>
    <controller type="pci" index="3" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="3" port="0x12"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x2"/>
    </controller>
    <controller type="pci" index="4" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="4" port="0x13"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x3"/>
    </controller>
    <controller type="pci" index="5" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="5" port="0x14"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x4"/>
    </controller>
    <controller type="pci" index="6" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="6" port="0x15"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x5"/>
    </controller>
    <controller type="pci" index="7" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="7" port="0x16"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x6"/>
    </controller>
    <controller type="pci" index="8" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="8" port="0x17"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x02" function="0x7"/>
    </controller>
    <controller type="pci" index="9" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="9" port="0x18"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x0" multifunction="on"/>
    </controller>
    <controller type="pci" index="10" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="10" port="0x19"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x1"/>
    </controller>
    <controller type="pci" index="11" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="11" port="0x1a"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x2"/>
    </controller>
    <controller type="pci" index="12" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="12" port="0x1b"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x3"/>
    </controller>
    <controller type="pci" index="13" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="13" port="0x1c"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x4"/>
    </controller>
    <controller type="pci" index="14" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="14" port="0x1d"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x03" function="0x5"/>
    </controller>
    <controller type="pci" index="15" model="pcie-root-port">
      <model name="pcie-root-port"/>
      <target chassis="15" port="0x8"/>
      <address type="pci" domain="0x0000" bus="0x00" slot="0x01" function="0x0"/>
    </controller>
    <controller type="pci" index="16" model="pcie-to-pci-bridge">
      <model name="pcie-pci-bridge"/>
      <address type="pci" domain="0x0000" bus="0x01" slot="0x00" function="0x0"/>
    </controller>
    <controller type="sata" index="0">
      <address type="pci" domain="0x0000" bus="0x00" slot="0x1f" function="0x2"/>
    </controller>
    <controller type="virtio-serial" index="0">
      <address type="pci" domain="0x0000" bus="0x03" slot="0x00" function="0x0"/>
    </controller>
    <interface type="network">
      <mac address="52:54:00:3e:fa:26"/>
      <source network="network"/>
      <model type="virtio"/>
      <driver queues="8"/>
      <address type="pci" domain="0x0000" bus="0x0b" slot="0x00" function="0x0"/>
    </interface>
    <input type="mouse" bus="ps2"/>
    <input type="keyboard" bus="ps2"/>
    <tpm model="tpm-crb">
      <backend type="emulator" version="2.0"/>
    </tpm>
    <audio id="1" type="none"/>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x58" slot="0x00" function="0x0"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x08" slot="0x00" function="0x0"/>
    </hostdev>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x59" slot="0x00" function="0x3"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x09" slot="0x00" function="0x0"/>
    </hostdev>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x59" slot="0x00" function="0x4"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x0a" slot="0x00" function="0x0"/>
    </hostdev>
    <hostdev mode="subsystem" type="usb" managed="yes">
      <source>
        <vendor id="0x26ce"/>
        <product id="0x0a06"/>
      </source>
      <address type="usb" bus="0" port="1"/>
    </hostdev>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x4a" slot="0x00" function="0x0"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x0c" slot="0x00" function="0x0"/>
    </hostdev>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x03" slot="0x00" function="0x0"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x04" slot="0x00" function="0x0"/>
    </hostdev>
    <hostdev mode="subsystem" type="pci" managed="yes">
      <source>
        <address domain="0x0000" bus="0x03" slot="0x00" function="0x1"/>
      </source>
      <address type="pci" domain="0x0000" bus="0x05" slot="0x00" function="0x0"/>
    </hostdev>
    <watchdog model="itco" action="reset"/>
    <memballoon model="none"/>
  </devices>
  <qemu:commandline>
    <qemu:arg value="-overcommit"/>
    <qemu:arg value="cpu-pm=on"/>
    <qemu:arg value="-fw_cfg"/>
    <qemu:arg value="opt/ovmf/X-PciMmio64Mb,string=65536"/>
  </qemu:commandline>
</domain>

BuzzBumbleBee · March 8, 2025, 10:08am

Also seems to be able to shutdown the VM and rebind to amdgpu

Alex_B1 · March 8, 2025, 12:39pm

Awesome! I’ve been struggling to get passthrough working with this card.

Looking forward to the additional info you can provide!

BuzzBumbleBee · March 8, 2025, 1:56pm

What have you tried so far, and what’s not working as expected?

If you have rebar enabled in bios you will have to manually set bar2 size. This is my startup process

stop window manager systemctl stop gdm
unbind from amdgpu echo 0000:03:00.0 > /sys/bus/pci/drivers/amdgpu/unbind (you will need to use the correct pcie device id for your statem
set bar2 to 8mb echo 3 > /sys/bus/pci/devices/0000:03:00.0/resource2_resize
restart window manager systemctl start gdm

You can start the VM as normal and on shutdown it will automatically rebind to amdgpu.

Some notes

Use lspci to find the correct pcie device id
Make sure to pass through both GPU devices
I have above 4g decode and resizable bar enabled in bios (along with the normal svm and iommu options)
You will have to change the gdm stop/start commands to suit what window manager you are using

RipClaw · March 8, 2025, 2:43pm

Can you try with cycling with multiple virtual OSs, Windows 7 , Windows 10, 11, Ubuntu LTS, Fedora, Suse etc, and see if the GPU does not get messed up ?

I mean launching one, then doing some GPU tasks, then shutting down & then launching the next OS via the same GPU ?

What I could make out from the forum is that each OS & device driver combo, can end up setting the internal state of the GPU in some different state.

Idea is to ensure for sure that irrespective of what OS & Driver & settings the GPU was running before, for the next OS run, the GPU virtually resets perfectly like a clean slate !

BuzzBumbleBee · March 8, 2025, 2:52pm

I can try that tomorrow, I’m going to try some more testing switching between windows guest and Linux host as that’s my main use case (I’ll need to get a Linux guest setup)

Alex_B1 · March 8, 2025, 3:05pm

I’m running the latest version of Unraid (7.0.1 Kernel 6.6.78).

The 9070xt just shows up as “AMD Device” in System Devices under the PCI Devices and IOMMU Groups section. I have both the VGA and Audio device bound to the VFIO at boot.

The VM boots with the GPU and sound device passed through (I know because I can hear the Windows 11 boot chime) but no video output and no libvirt errors.

wendell · March 8, 2025, 3:19pm

if the GPU crashes it doesn’t become clean is the rubnive found. that’s true even in a non vfio context. i.e. cyberpunk crashes and you might even have to power cycle let alone reboot.

disabling split lock helped a lot for stability for me

BuzzBumbleBee · March 8, 2025, 4:18pm

@wendell / @Alex_B1 iv added more information to my main post.

Will grab the bios version from my card in a moment, if you two can as well that would be interesting to compare to

BuzzBumbleBee · March 8, 2025, 4:38pm

GPU bios info

BuzzBumbleBee · March 8, 2025, 9:43pm

A quick superposition benchmark indicates that the GPU is working along the same lines as others. (Googled some other scores for 1080p extreme and they are in the same ballpark)

Precific · March 8, 2025, 10:09pm

I had to uninstall the old AMD drivers first (switched from a 6700 XT, did not update drivers beforehand). The GPU’s PCIe devices were not visible in the Windows guest for some reason, the driver installer did not find them either.

With that done, the guest performance with my 9070 XT (Sapphire Pulse) is exactly how I expected it to be.
I haven’t tested VM shutdowns/reset behaviour so far, though.

Edit: Host=Manjaro with Kernel 6.13.5, 7950X3D, Asrock X670E Steel Legend

Edit: Nope, the GPU enters a broken state as soon as I boot it into a VM. Once the VM is shut down, trying to change the PCIe bars yields a “device busy” error (with a corresponding ‘unable to resize’ error in dmesg).
What has worked so far is to attach the GPU to the already-running guest. Restarting the guest (without shutting down the VM) works fine, the GPU even displays the boot screen. It breaks once I start a VM with the GPU attached from the get-go.

quality_junkie · March 9, 2025, 5:06pm

Do you have Cyberpunk? Can you please see if the game runs at all on Win11? On Win10 my first launch was very slow/stuttery, but the game eventually loaded and ran for about a minute, then crashed. Next launches after that it was crashing instantly. I had to remove the shaders in %localappdata%\AMD for it to start and go thu slow loading time and crash after a minute again.

Windows 10 22H2 Build 19045.5552
AMD Software: Adrenalin Edition 25.3.1 Driver Version 24.30.31.03
Also downloaded and tried AMD Software: Adrenalin 25.2.1 Optional Update Driver Version 24.20.33.05 but it refused to install.

BuzzBumbleBee · March 9, 2025, 6:58pm

Ill start it downloading now

BuzzBumbleBee · March 9, 2025, 8:10pm

It seems to run ok, iv attached a video of how it’s running for me

quality_junkie · March 9, 2025, 8:18pm

Interesting… Thanks for the effort! I guess the next things for me to try:

Start with fresh Win10 installation.
If (1) fails try Win11.
If (1) and (2) fail start with fresh VM xml.

BuzzBumbleBee · March 9, 2025, 9:09pm

No worries, I played for about 15 min and it was perfectly stable and performance is in line with reviews.

Out of interest what’s the rest of your specs (bios and package versions also)

mart · March 10, 2025, 12:01am

Thanks for all the info, will save this for later.

quality_junkie · March 10, 2025, 1:54am

Ok, I ‘fixed’ it.

TL;DR download more RAM bro.

Before I started doing anything I decided to have another look at your XML file. The very first thing I noticed that you don’t use hugepages, I thought “weird, but ok”. I removed hugepages from my XML – had no effect. I reverted the change and decided to check the Event Viewer in Windows. Found nothing suspicious in the ‘Application’ tab, but encounter something interesting in the ‘System’ tab. Warning “Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: Cyberpunk2077.exe (11444) consumed 17629413376 bytes, AMDRSServ.exe (11744) consumed 743927808 bytes, and MsMpEng.exe (3948) consumed 307421184 bytes.” Cyberpunk eating 17 gigs of memory, even tho I only allocated 16 for the VM, but I also have a pagefile of 8. For some reason I couldn’t submit to the idea that 16 gigs is not enough for any game, there was no way, especially when your setup is using 14.

Windows version of OOM Killer was just killing the process. At that point I thought to myself: “before I start this Windows reinstallation nonsense, let me just increase the damn thing (especially when I have 64 total on the host) and see what happens”. I changed the kernel parameters from
rw amd_iommu=on iommu=pt default_hugepagesz=1G hugepagesz=1G hugepages=16
to
rw amd_iommu=on iommu=pt default_hugepagesz=1G hugepagesz=1G hugepages=24
and in virt manager from 16384 to 24576. Booted the VM, cleared the %localappdata%\AMD shaders and started the game. It loaded no problem. Here are the vids of ‘before’ and ‘after’ (can’t include the full links).

Before: 16GB RAM – 1080p

watch?v=OCzI0g79DVQ

After: 24GB RAM – 1080p

watch?v=YhQSgqQRmLw

After: 24GB RAM – 1440p downscaled to 1080p with AMD’s VSR

watch?v=sUCOxcc_9LU

And with mitigations=off kernel parameter I got ~14 Avrg FPS increase

As for my specs, I got Ryzen 3900X, Crosshair VIII Hero, 4x16 G Skill Trident Z Neo at 3600 MHz and replaced my Asus 2070S with Gigabyte Windforce 9070 XT. Pretty old stuff, didn’t change anything since 2020.

P.S. I’m not sure this is 100% fix, as I only tested benchmark and a little bit of gameplay. Long play sessions may prove that this is not a fix, but a band aid. But at least I started with not being able to play the game at all to benching and recording a vid at the same time

quality_junkie · March 10, 2025, 2:14am

Forgot to mention, I also have a 1050Ti for my host. Two monitors, first connected to the 1050Ti, second connected to the ‘main’ GPU. I don’t have to kill the display manager, unbind amdgpu and start the display manager. I just press ‘Play’ button in the virt manager and amdgpu driver does its thing. The only change I had to make from my previous 2070S setup was to comment out the options vfio-pci ids=... in the /etc/modprobe.d/vfio.conf file and let the amdgpu to take control.