Asus WRX80E-Sage, Threadripper Pro, RX 6900 XT works on host but not in vm

So, given: Asus WRX80E-Sage with Threadripper Pro 3975WX and an RX 6900 XT plugged into it (bottom slot).

Runs Arch Linux, latest, with PREEMPT_VOLUNTARY turned on (qemu large guest ram slowdown bug fix).

Everything works fine, GPU is detected and runs OpenCL code without issues (opencl-amd package).

Now, i want to pass it through to a VM.

Everything seems to work fine, there are no new errors i can see on either guest or host, the guest detects the GPU just fine, but it does not work.

On Linux (a copy of host system), clinfo returns no devices and Xorg runs 3D stuff without acceleration.

On Windows, installing AMD drivers results in some variant of a blank screen or no signal mid-boot.

Both work in generic/vesa mode, that is there is an image on screen plugged into the GPU.

Both VMs work fine on another system with i9-10900K and GTX 1650, so at least the basic setup seem to be correct.

Once again, no errors is given anywhere at any stage and i tried everyting easily googleable, so i have no clue what to look for.
Is there some trick to it that i’m missing?

BIOS settings: CSM off, tried with and without resizeable bar, sr-iov on.

Tried to pass through or reset 01:00.0 and 02:00.0, former didn’t work, latter hangs the guest at boot.

Host kernel command line:

hugepagesz=1G default_hugepagesz=1G iommu=pt amd_iommu=on video=efifb:off vfio-pci.ids=1002:73bf,1002:ab28,1002:1478,1002:1479,1022:148c

QEMU parameters:

qemu-system-x86_64 \
-enable-kvm -m 16384 -mem-path /dev/hugepages \
-cpu host,kvm=off,hv-vendor-id=moxprox -smp cores=8,threads=1,sockets=1 -machine q35 \
-drive if=pflash,format=raw,readonly=on,file=ovmf_code.fd \
-drive if=pflash,format=raw,file=ovmf_vars-1024x768.fd \
-smbios type=2 \
-netdev bridge,id=net0,br=br0,"helper=/usr/lib/qemu/qemu-bridge-helper" \
-device e1000,netdev=net0,mac=00:25:4B:00:00:02 \
-device nvme,drive=nvme0,serial=deadbeaf1,max_ioqpairs=8 -drive file=vm2_sys.qcow2,if=none,id=nvme0 \
-device vfio-pci,host=30:00.3 \
-device vfio-pci,host=03:00.0 \
-device vfio-pci,host=03:00.1 \
-vga none

IOMMU groups:

IOMMU Group 0:
	60:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 1:
	60:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 2:
	60:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 3:
	60:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 4:
	60:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 5:
	60:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 6:
	60:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 7:
	60:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 8:
	60:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 9:
	61:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 10:
	62:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 11:
	40:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
	40:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 12:
	40:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 13:
	40:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 14:
	40:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 15:
	40:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 16:
	40:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 17:
	40:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 18:
	40:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 19:
	40:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 20:
	42:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 21:
	43:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 22:
	20:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 23:
	20:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 24:
	20:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 25:
	20:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 26:
	20:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 27:
	20:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 28:
	20:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 29:
	20:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 30:
	20:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 31:
	20:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 32:
	20:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 33:
	21:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream [1022:57ad]
IOMMU Group 34:
	22:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 35:
	22:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 36:
	22:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 37:
	22:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 38:
	22:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 39:
	22:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a3]
IOMMU Group 40:
	22:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
	2b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
	2b:00.1 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
	2b:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller [1022:149c]
IOMMU Group 41:
	22:09.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
	2c:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 42:
	22:0a.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge [1022:57a4]
	2d:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] [1022:7901] (rev 51)
IOMMU Group 43:
	23:00.0 USB controller [0c03]: ASMedia Technology Inc. ASM3242 USB 3.2 Host Controller [1b21:3242]
IOMMU Group 44:
	24:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
IOMMU Group 45:
	24:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
IOMMU Group 46:
	26:00.0 Network controller [0280]: Intel Corporation Wi-Fi 6 AX200 [8086:2723] (rev 1a)
IOMMU Group 47:
	27:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 02)
IOMMU Group 48:
	28:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial ATA Controller [1b21:0612] (rev 02)
IOMMU Group 49:
	29:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 04)
	2a:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 41)
IOMMU Group 50:
	2e:00.0 Non-Volatile memory controller [0108]: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO [144d:a80a]
IOMMU Group 51:
	2f:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 52:
	30:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 53:
	30:00.1 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP [1022:1486]
IOMMU Group 54:
	30:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]
IOMMU Group 55:
	30:00.4 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller [1022:1487]
IOMMU Group 56:
	00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 57:
	00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 58:
	00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 59:
	00:03.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge [1022:1483]
IOMMU Group 60:
	00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 61:
	00:05.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 62:
	00:07.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 63:
	00:07.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 64:
	00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge [1022:1482]
IOMMU Group 65:
	00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B] [1022:1484]
IOMMU Group 66:
	00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 61)
	00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 67:
	00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 0 [1022:1490]
	00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 1 [1022:1491]
	00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 2 [1022:1492]
	00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 3 [1022:1493]
	00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 4 [1022:1494]
	00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 5 [1022:1495]
	00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 6 [1022:1496]
	00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship Device 24; Function 7 [1022:1497]
IOMMU Group 68:
	01:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch [1002:1478] (rev c0)
IOMMU Group 69:
	02:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch [1002:1479]
IOMMU Group 70:
	03:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 [Radeon RX 6800/6800 XT / 6900 XT] [1002:73bf] (rev c0)
IOMMU Group 71:
	03:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 HDMI Audio [Radeon RX 6800/6800 XT / 6900 XT] [1002:ab28]
IOMMU Group 72:
	04:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function [1022:148a]
IOMMU Group 73:
	05:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP [1022:1485]
IOMMU Group 74:
	05:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Starship USB 3.0 Host Controller [1022:148c]

Host dmesg when GPU is available to it (not VFIO), (known-unrelated stuff cut out to fit the char limit):

[    3.135339] ast 0000:2a:00.0: [drm] P2A bridge disabled, using default configuration
[    3.135341] ast 0000:2a:00.0: [drm] AST 2500 detected
[    3.135350] ast 0000:2a:00.0: [drm] Analog VGA only
[    3.135351] ast 0000:2a:00.0: [drm] dram MCLK=800 Mhz type=1 bus_width=16
[    3.135427] [TTM] Zone  kernel: Available graphics memory: 65767246 KiB
[    3.135428] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[    3.135590] [drm] Initialized ast 0.1.0 20120228 for 0000:2a:00.0 on minor 0
[    3.140610] ast 0000:2a:00.0: [drm] fb1: astdrmfb frame buffer device
[    3.250615] thermal thermal_zone0: failed to read out thermal zone (-61)
[    3.731433] [drm] amdgpu kernel modesetting enabled.
[    3.731549] amdgpu: Ignoring ACPI CRAT on non-APU system
[    3.731555] Virtual CRAT table created for CPU
[    3.731563] amdgpu: Topology: Add CPU node
[    3.731803] checking generic (1fc00000000 300000) vs hw (1fc00000000 400000000)
[    3.731805] fb0: switching to amdgpudrmfb from EFI VGA
[    3.733690] Console: switching to colour dummy device 80x25
[    3.733705] amdgpu 0000:03:00.0: vgaarb: deactivate vga console
[    3.733747] amdgpu 0000:03:00.0: enabling device (0006 -> 0007)
[    3.733831] [drm] initializing kernel modesetting (SIENNA_CICHLID 0x1002:0x73BF 0x1849:0x5212 0xC0).
[    3.733835] amdgpu 0000:03:00.0: amdgpu: Trusted Memory Zone (TMZ) feature not supported
[    3.733907] [drm] register mmio base: 0xF6000000
[    3.733908] [drm] register mmio size: 1048576
[    3.735607] [drm] add ip block number 0 <nv_common>
[    3.735609] [drm] add ip block number 1 <gmc_v10_0>
[    3.735610] [drm] add ip block number 2 <navi10_ih>
[    3.735611] [drm] add ip block number 3 <psp>
[    3.735612] [drm] add ip block number 4 <smu>
[    3.735613] [drm] add ip block number 5 <dm>
[    3.735614] [drm] add ip block number 6 <gfx_v10_0>
[    3.735616] [drm] add ip block number 7 <sdma_v5_2>
[    3.735617] [drm] add ip block number 8 <vcn_v3_0>
[    3.735617] [drm] add ip block number 9 <jpeg_v3_0>
[    3.735647] amdgpu 0000:03:00.0: amdgpu: Fetched VBIOS from VFCT
[    3.735649] amdgpu: ATOM BIOS: 113-EXT800216-L05
[    3.735665] [drm] VCN(0) decode is enabled in VM mode
[    3.735666] [drm] VCN(1) decode is enabled in VM mode
[    3.735667] [drm] VCN(0) encode is enabled in VM mode
[    3.735667] [drm] VCN(1) encode is enabled in VM mode
[    3.735669] [drm] JPEG decode is enabled in VM mode
[    3.735696] amdgpu 0000:03:00.0: amdgpu: HBM ECC is not presented.
[    3.735697] amdgpu 0000:03:00.0: amdgpu: SRAM ECC is not presented.
[    3.735702] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    3.735710] amdgpu 0000:03:00.0: amdgpu: VRAM: 16368M 0x0000008000000000 - 0x00000083FEFFFFFF (16368M used)
[    3.735711] amdgpu 0000:03:00.0: amdgpu: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
[    3.735713] amdgpu 0000:03:00.0: amdgpu: AGP: 267894784M 0x0000008400000000 - 0x0000FFFFFFFFFFFF
[    3.735721] [drm] Detected VRAM RAM=16368M, BAR=16384M
[    3.735722] [drm] RAM width 256bits GDDR6
[    3.735836] [drm] amdgpu: 16368M of VRAM memory ready
[    3.735837] [drm] amdgpu: 16368M of GTT memory ready.
[    3.735848] [drm] GART: num cpu pages 131072, num gpu pages 131072
[    3.736007] [drm] PCIE GART of 512M enabled (table at 0x0000008000300000).
[    5.471654] [drm] Loading DMUB firmware via PSP: version=0x00000000
[    5.476289] [drm] use_doorbell being set to: [true]
[    5.476331] [drm] use_doorbell being set to: [true]
[    5.476372] [drm] use_doorbell being set to: [true]
[    5.476416] [drm] use_doorbell being set to: [true]
[    5.477034] [drm] Found VCN firmware Version ENC: 1.13 DEC: 2 VEP: 0 Revision: 20
[    5.477040] [drm] PSP loading VCN firmware
[    5.659992] [drm] reserve 0xa00000 from 0x83fe000000 for PSP TMR
[    5.776296] amdgpu 0000:03:00.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
[    5.776330] amdgpu 0000:03:00.0: amdgpu: use vbios provided pptable
[    5.848469] amdgpu 0000:03:00.0: amdgpu: SMU is initialized successfully!
[    5.848876] [drm] Display Core initialized with v3.2.122!
[    5.850232] [drm] DMUB hardware initialized: version=0x02000018
[    6.110229] [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:480
[    6.139158] [drm] kiq ring mec 2 pipe 1 q 0
[    6.145478] [drm] VCN decode and encode initialized successfully(under DPG Mode).
[    6.145697] [drm] JPEG decode initialized successfully.
[    6.148967] Virtual CRAT table created for GPU
[    6.149101] amdgpu: Topology: Add dGPU node [0x73bf:0x1002]
[    6.149103] kfd kfd: added device 1002:73bf
[    6.149104] amdgpu 0000:03:00.0: amdgpu: SE 4, SH per SE 2, CU per SH 10, active_cu_number 80
[    6.150411] [drm] fb mappable at 0x1FC0056B000
[    6.150412] [drm] vram apper at 0x1FC00000000
[    6.150413] [drm] size 8294400
[    6.150414] [drm] fb depth is 24
[    6.150414] [drm]    pitch is 7680
[    6.150460] fbcon: amdgpudrmfb (fb0) is primary device
[    6.408078] [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:480
[    6.408097] ------------[ cut here ]------------
[    6.408098] WARNING: CPU: 37 PID: 742 at drivers/gpu/drm/amd/amdgpu/../display/dc/dcn30/dcn30_hwseq.c:959 dcn30_set_hubp_blank+0x214/0x220 [amdgpu]
[    6.408253] Modules linked in: snd_usb_audio(+) snd_usbmidi_lib snd_rawmidi snd_seq_device mc hid_logitech_dj(+) ipmi_ssif mousedev joydev btusb btrtl btbcm btintel bluetooth sunrpc usbhid ecdh_generic ecc intel_rapl_msr intel_rapl_common amd64_edac edac_mce_amd amd_energy crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel vfat crypto_simd fat cryptd amdgpu(+) eeepc_wmi asus_wmi sparse_keymap video rapl wmi_bmof mxm_wmi pcspkr iwlmvm mac80211 libarc4 iwlwifi snd_hda_codec_hdmi snd_hda_intel ast snd_intel_dspcfg snd_intel_sdw_acpi cfg80211 drm_vram_helper gpu_sched snd_hda_codec i2c_algo_bit drm_ttm_helper ixgbe(+) ttm snd_hda_core drm_kms_helper snd_hwdep ccp snd_pcm rng_core mdio_devres snd_timer libphy syscopyarea sysfillrect sysimgblt snd fb_sys_fops mdio cec rfkill acpi_ipmi dca sp5100_tco soundcore ipmi_si i2c_piix4 k10temp ipmi_devintf ipmi_msghandler wmi pinctrl_amd mac_hid acpi_cpufreq drm fuse agpgart bpf_preload ip_tables x_tables ext4 crc32c_generic crc16 mbcache
[    6.408288]  jbd2 crc32c_intel xhci_pci xhci_pci_renesas vfio_pci vfio_virqfd vfio_iommu_type1 vfio
[    6.408291] CPU: 37 PID: 742 Comm: systemd-udevd Not tainted 5.12.14-arch1-1-custom #1
[    6.408293] Hardware name: ASUS System Product Name/Pro WS WRX80E-SAGE SE WIFI, BIOS 0504 06/02/2021
[    6.408294] RIP: 0010:dcn30_set_hubp_blank+0x214/0x220 [amdgpu]
[    6.408437] Code: 31 f6 48 8b 07 48 8b 40 50 e8 e8 1b 18 d1 48 8b 9b d0 02 00 00 48 85 db 75 df eb 8c 0f 0b e9 46 ff ff ff 0f 0b e9 be fe ff ff <0f> 0b e9 42 fe ff ff 0f 1f 44 00 00 0f 1f 44 00 00 41 57 41 56 45
[    6.408438] RSP: 0018:ffffad8d230670d8 EFLAGS: 00010246
[    6.408439] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000003
[    6.408440] RDX: 0000000000000000 RSI: 0000000000003ab3 RDI: ffff9818c8280000
[    6.408441] RBP: ffff9818cd9a01e8 R08: ffffad8d230670c4 R09: 0000000000000002
[    6.408442] R10: 3038343a656e696c R11: 343a656e696c2063 R12: ffff9818cd9a01e8
[    6.408442] R13: ffff9818c8490000 R14: 0000000000000000 R15: ffff9818cd9a01e8
[    6.408443] FS:  00007fb594d3ca40(0000) GS:ffff98367db40000(0000) knlGS:0000000000000000
[    6.408444] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    6.408445] CR2: 00007fb5956808e0 CR3: 000000013b7dc000 CR4: 0000000000350ee0
[    6.408445] Call Trace:
[    6.408449]  dcn10_wait_for_mpcc_disconnect+0x116/0x190 [amdgpu]
[    6.408589]  dcn20_plane_atomic_disable+0x3e/0x150 [amdgpu]
[    6.408730]  dcn20_disable_plane+0x24/0x40 [amdgpu]
[    6.408866]  dcn10_init_pipes+0x307/0x3f0 [amdgpu]
[    6.409001]  dce110_enable_accelerated_mode+0x9c/0x260 [amdgpu]
[    6.409134]  dc_commit_state+0x983/0xa80 [amdgpu]
[    6.409264]  amdgpu_dm_atomic_commit_tail+0x5ee/0x2620 [amdgpu]
[    6.409414]  commit_tail+0x94/0x120 [drm_kms_helper]
[    6.409425]  drm_atomic_helper_commit+0x113/0x140 [drm_kms_helper]
[    6.409435]  drm_client_modeset_commit_atomic+0x1fc/0x240 [drm]
[    6.409454]  drm_client_modeset_commit_locked+0x56/0x150 [drm]
[    6.409470]  drm_client_modeset_commit+0x24/0x40 [drm]
[    6.409486]  drm_fb_helper_set_par+0xa5/0xd0 [drm_kms_helper]
[    6.409495]  fbcon_init+0x27c/0x500
[    6.409499]  visual_init+0xcc/0x120
[    6.409502]  do_bind_con_driver.isra.0+0x1c2/0x2c0
[    6.409504]  do_take_over_console+0x116/0x180
[    6.409506]  do_fbcon_takeover+0x58/0xb0
[    6.409507]  fbcon_fb_registered+0x81/0xf0
[    6.409509]  register_framebuffer+0x1f6/0x310
[    6.409512]  __drm_fb_helper_initial_config_and_unlock+0x337/0x4a0 [drm_kms_helper]
[    6.409522]  amdgpu_fbdev_init+0xb9/0xf0 [amdgpu]
[    6.409633]  amdgpu_device_init.cold+0x15e5/0x1a11 [amdgpu]
[    6.409774]  amdgpu_driver_load_kms+0x65/0x260 [amdgpu]
[    6.409883]  amdgpu_pci_probe+0x11f/0x1b0 [amdgpu]
[    6.409990]  local_pci_probe+0x42/0x80
[    6.409992]  ? __cond_resched+0x16/0x40
[    6.409995]  pci_device_probe+0xfa/0x1b0
[    6.409997]  really_probe+0xf2/0x440
[    6.410000]  driver_probe_device+0xe1/0x150
[    6.410001]  device_driver_attach+0xa1/0xb0
[    6.410003]  __driver_attach+0x8a/0x150
[    6.410004]  ? device_driver_attach+0xb0/0xb0
[    6.410006]  ? device_driver_attach+0xb0/0xb0
[    6.410007]  bus_for_each_dev+0x89/0xd0
[    6.410009]  bus_add_driver+0x12b/0x1e0
[    6.410010]  driver_register+0x8f/0xe0
[    6.410012]  ? 0xffffffffc1a47000
[    6.410013]  do_one_initcall+0x57/0x1e0
[    6.410016]  do_init_module+0x5c/0x270
[    6.410019]  load_module+0x2545/0x2720
[    6.410022]  ? __do_sys_init_module+0x12e/0x1b0
[    6.410023]  __do_sys_init_module+0x12e/0x1b0
[    6.410026]  do_syscall_64+0x33/0x40
[    6.410028]  entry_SYSCALL_64_after_hwframe+0x44/0xae
[    6.410030] RIP: 0033:0x7fb59567232e
[    6.410031] Code: 48 8b 0d 45 0b 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 12 0b 0c 00 f7 d8 64 89 01 48
[    6.410032] RSP: 002b:00007ffc043ebe98 EFLAGS: 00000246 ORIG_RAX: 00000000000000af
[    6.410034] RAX: ffffffffffffffda RBX: 000055a0606d9530 RCX: 00007fb59567232e
[    6.410034] RDX: 00007fb5957c9a9d RSI: 0000000000d0fc81 RDI: 00007fb59303a010
[    6.410035] RBP: 00007fb59303a010 R08: 000055a06071d030 R09: 0000000000d0fc90
[    6.410035] R10: 000055a53a775d1d R11: 0000000000000246 R12: 00007fb5957c9a9d
[    6.410036] R13: 000055a0606d9530 R14: 000055a06071be90 R15: 000055a0606d9530
[    6.410037] ---[ end trace 1cb0f7c2bb346eaa ]---
[    6.494192] ixgbe 0000:24:00.1: 31.504 Gb/s available PCIe bandwidth (8.0 GT/s PCIe x4 link)
[    6.510311] Console: switching to colour frame buffer device 240x67
[    6.528240] amdgpu 0000:03:00.0: [drm] fb0: amdgpudrmfb frame buffer device
[    6.528322] amdgpu 0000:03:00.0: amdgpu: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
[    6.528324] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    6.528325] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    6.528327] amdgpu 0000:03:00.0: amdgpu: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    6.528328] amdgpu 0000:03:00.0: amdgpu: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    6.528329] amdgpu 0000:03:00.0: amdgpu: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    6.528330] amdgpu 0000:03:00.0: amdgpu: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    6.528331] amdgpu 0000:03:00.0: amdgpu: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    6.528332] amdgpu 0000:03:00.0: amdgpu: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    6.528333] amdgpu 0000:03:00.0: amdgpu: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    6.528334] amdgpu 0000:03:00.0: amdgpu: ring sdma0 uses VM inv eng 12 on hub 0
[    6.528335] amdgpu 0000:03:00.0: amdgpu: ring sdma1 uses VM inv eng 13 on hub 0
[    6.528336] amdgpu 0000:03:00.0: amdgpu: ring sdma2 uses VM inv eng 14 on hub 0
[    6.528337] amdgpu 0000:03:00.0: amdgpu: ring sdma3 uses VM inv eng 15 on hub 0
[    6.528338] amdgpu 0000:03:00.0: amdgpu: ring vcn_dec_0 uses VM inv eng 0 on hub 1
[    6.528339] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_0.0 uses VM inv eng 1 on hub 1
[    6.528340] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_0.1 uses VM inv eng 4 on hub 1
[    6.528341] amdgpu 0000:03:00.0: amdgpu: ring vcn_dec_1 uses VM inv eng 5 on hub 1
[    6.528342] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_1.0 uses VM inv eng 6 on hub 1
[    6.528343] amdgpu 0000:03:00.0: amdgpu: ring vcn_enc_1.1 uses VM inv eng 7 on hub 1
[    6.528344] amdgpu 0000:03:00.0: amdgpu: ring jpeg_dec uses VM inv eng 8 on hub 1
[    6.529298] amdgpu 0000:03:00.0: amdgpu: Using BACO for runtime pm
[    6.529629] [drm] Initialized amdgpu 3.40.0 20150101 for 0000:03:00.0 on minor 1

Host dmesg when set for VFIO (known-unrelated stuff cut out to fit the char limit):

[    2.173213] VFIO - User Level meta-driver version: 0.3
[    2.178487] vfio-pci 0000:03:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=none
[    2.207034] vfio_pci: add [1002:73bf[ffffffff:ffffffff]] class 0x000000/00000000
[    2.237488] vfio_pci: add [1002:ab28[ffffffff:ffffffff]] class 0x000000/00000000
[    2.237510] vfio_pci: add [1002:1478[ffffffff:ffffffff]] class 0x000000/00000000
[    2.237516] vfio_pci: add [1002:1479[ffffffff:ffffffff]] class 0x000000/00000000
[    2.297053] vfio_pci: add [1022:148c[ffffffff:ffffffff]] class 0x000000/00000000
[    3.197736] ast 0000:2a:00.0: [drm] P2A bridge disabled, using default configuration
[    3.197738] ast 0000:2a:00.0: [drm] AST 2500 detected
[    3.197748] ast 0000:2a:00.0: [drm] Analog VGA only
[    3.197749] ast 0000:2a:00.0: [drm] dram MCLK=800 Mhz type=1 bus_width=16
[    3.197817] [TTM] Zone  kernel: Available graphics memory: 65734158 KiB
[    3.197819] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[    3.198028] [drm] Initialized ast 0.1.0 20120228 for 0000:2a:00.0 on minor 0
[    3.216591] Console: switching to colour frame buffer device 128x48
[    3.217883] ast 0000:2a:00.0: [drm] fb0: astdrmfb frame buffer device
[    4.066359] thermal thermal_zone0: failed to read out thermal zone (-61)
[    4.100946] [drm] amdgpu kernel modesetting enabled.
[    4.101132] amdgpu: Ignoring ACPI CRAT on non-APU system
[    4.101139] Virtual CRAT table created for CPU
[    4.101151] amdgpu: Topology: Add CPU node
[    4.102432] AMD64 EDAC driver v3.5.0

Guest dmesg (full):

[    0.000000] Linux version 5.12.14-arch1-1-custom ([email protected]) (gcc (GCC) 11.1.0, GNU ld (GNU Binutils) 2.36.1) #1 SMP Thu, 08 Jul 2021 06:13:09 +0000
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-linux-custom root=UUID=86913e9d-18bf-48c5-9257-4c0c9a470aa6 rw loglevel=3 quiet audit=0
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000007fffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000800000-0x0000000000807fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000000808000-0x000000000080ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000810000-0x00000000008fffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x0000000000900000-0x000000007e570fff] usable
[    0.000000] BIOS-e820: [mem 0x000000007e571000-0x000000007e571fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007e572000-0x000000007e572fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007e573000-0x000000007e9f3fff] usable
[    0.000000] BIOS-e820: [mem 0x000000007e9f4000-0x000000007e9fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007e9ff000-0x000000007eab4fff] usable
[    0.000000] BIOS-e820: [mem 0x000000007eab5000-0x000000007eab8fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007eab9000-0x000000007eabafff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007eabb000-0x000000007eac2fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007eac3000-0x000000007eadafff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007eadb000-0x000000007eafafff] usable
[    0.000000] BIOS-e820: [mem 0x000000007eafb000-0x000000007eb1afff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007eb1b000-0x000000007fb9afff] usable
[    0.000000] BIOS-e820: [mem 0x000000007fb9b000-0x000000007fbcafff] type 20
[    0.000000] BIOS-e820: [mem 0x000000007fbcb000-0x000000007fbf2fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007fbf3000-0x000000007fbfafff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007fbfb000-0x000000007fbfefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000007fbff000-0x000000007ff1ffff] usable
[    0.000000] BIOS-e820: [mem 0x000000007ff20000-0x000000007ff3ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007ff40000-0x000000007fffffff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffe00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000047fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] efi: EFI v2.70 by EDK II
[    0.000000] efi: SMBIOS=0x7fbcc000 ACPI=0x7fbfa000 ACPI 2.0=0x7fbfa014 MEMATTR=0x7ef8d018 
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009)/Standard PC (Q35 + ICH9, 2009), BIOS 0.0.0 02/06/2015
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 3493.525 MHz processor
[    0.000061] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000063] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000068] last_pfn = 0x480000 max_arch_pfn = 0x400000000
[    0.000092] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000099] last_pfn = 0x7ff20 max_arch_pfn = 0x400000000
[    0.003318] Using GB pages for direct mapping
[    0.003486] Secure boot could not be determined
[    0.003487] RAMDISK: [mem 0x3704f000-0x3781efff]
[    0.003488] ACPI: Early table checksum verification disabled
[    0.003490] ACPI: RSDP 0x000000007FBFA014 000024 (v02 BOCHS )
[    0.003493] ACPI: XSDT 0x000000007FBF90E8 00005C (v01 BOCHS  BXPC     00000001      01000013)
[    0.003496] ACPI: FACP 0x000000007FBF5000 0000F4 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003499] ACPI: DSDT 0x000000007FBF6000 002135 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003502] ACPI: FACS 0x000000007FBFD000 000040
[    0.003503] ACPI: APIC 0x000000007FBF4000 0000B0 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003505] ACPI: HPET 0x000000007FBF3000 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003507] ACPI: MCFG 0x000000007EABA000 00003C (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003509] ACPI: WAET 0x000000007EAB9000 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.003511] ACPI: VFCT 0x000000007E9F4000 00AC84 (v01 BOCHS  BXPC     00000001 AMD  31504F47)
[    0.003513] ACPI: BGRT 0x000000007E571000 000038 (v01 INTEL  EDK2     00000002      01000013)
[    0.003515] ACPI: Reserving FACP table memory at [mem 0x7fbf5000-0x7fbf50f3]
[    0.003516] ACPI: Reserving DSDT table memory at [mem 0x7fbf6000-0x7fbf8134]
[    0.003517] ACPI: Reserving FACS table memory at [mem 0x7fbfd000-0x7fbfd03f]
[    0.003517] ACPI: Reserving APIC table memory at [mem 0x7fbf4000-0x7fbf40af]
[    0.003518] ACPI: Reserving HPET table memory at [mem 0x7fbf3000-0x7fbf3037]
[    0.003519] ACPI: Reserving MCFG table memory at [mem 0x7eaba000-0x7eaba03b]
[    0.003519] ACPI: Reserving WAET table memory at [mem 0x7eab9000-0x7eab9027]
[    0.003520] ACPI: Reserving VFCT table memory at [mem 0x7e9f4000-0x7e9fec83]
[    0.003521] ACPI: Reserving BGRT table memory at [mem 0x7e571000-0x7e571037]
[    0.003530] ACPI: Local APIC address 0xfee00000
[    0.003643] No NUMA configuration found
[    0.003644] Faking a node at [mem 0x0000000000000000-0x000000047fffffff]
[    0.003646] NODE_DATA(0) allocated [mem 0x47fffc000-0x47fffffff]
[    0.003668] Zone ranges:
[    0.003668]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.003670]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.003671]   Normal   [mem 0x0000000100000000-0x000000047fffffff]
[    0.003672]   Device   empty
[    0.003672] Movable zone start for each node
[    0.003673] Early memory node ranges
[    0.003673]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.003674]   node   0: [mem 0x0000000000100000-0x00000000007fffff]
[    0.003675]   node   0: [mem 0x0000000000808000-0x000000000080ffff]
[    0.003676]   node   0: [mem 0x0000000000900000-0x000000007e570fff]
[    0.003676]   node   0: [mem 0x000000007e573000-0x000000007e9f3fff]
[    0.003677]   node   0: [mem 0x000000007e9ff000-0x000000007eab4fff]
[    0.003677]   node   0: [mem 0x000000007eadb000-0x000000007eafafff]
[    0.003678]   node   0: [mem 0x000000007eb1b000-0x000000007fb9afff]
[    0.003678]   node   0: [mem 0x000000007fbff000-0x000000007ff1ffff]
[    0.003679]   node   0: [mem 0x0000000100000000-0x000000047fffffff]
[    0.003681] Initmem setup node 0 [mem 0x0000000000001000-0x000000047fffffff]
[    0.003682] On node 0 totalpages: 4193552
[    0.003683]   DMA zone: 59 pages used for memmap
[    0.003683]   DMA zone: 1951 pages reserved
[    0.003684]   DMA zone: 3751 pages, LIFO batch:0
[    0.003910]   DMA zone: 29017 pages in unavailable ranges
[    0.003911]   DMA32 zone: 8122 pages used for memmap
[    0.003911]   DMA32 zone: 519785 pages, LIFO batch:63
[    0.007428]   DMA32 zone: 407 pages in unavailable ranges
[    0.007431]   Normal zone: 57344 pages used for memmap
[    0.007432]   Normal zone: 3670016 pages, LIFO batch:63
[    0.032717] ACPI: PM-Timer IO Port: 0x608
[    0.032721] ACPI: Local APIC address 0xfee00000
[    0.032728] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.032749] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.032751] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.032753] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.032754] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.032755] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.032756] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.032757] ACPI: IRQ0 used by override.
[    0.032757] ACPI: IRQ5 used by override.
[    0.032758] ACPI: IRQ9 used by override.
[    0.032758] ACPI: IRQ10 used by override.
[    0.032759] ACPI: IRQ11 used by override.
[    0.032760] Using ACPI (MADT) for SMP configuration information
[    0.032761] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.032768] e820: update [mem 0x7ed1c000-0x7ed3ffff] usable ==> reserved
[    0.032776] TSC deadline timer available
[    0.032779] smpboot: Allowing 8 CPUs, 0 hotplug CPUs
[    0.032803] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.032805] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.032806] PM: hibernation: Registered nosave memory: [mem 0x00800000-0x00807fff]
[    0.032807] PM: hibernation: Registered nosave memory: [mem 0x00810000-0x008fffff]
[    0.032808] PM: hibernation: Registered nosave memory: [mem 0x7e571000-0x7e571fff]
[    0.032809] PM: hibernation: Registered nosave memory: [mem 0x7e572000-0x7e572fff]
[    0.032810] PM: hibernation: Registered nosave memory: [mem 0x7e9f4000-0x7e9fefff]
[    0.032811] PM: hibernation: Registered nosave memory: [mem 0x7eab5000-0x7eab8fff]
[    0.032812] PM: hibernation: Registered nosave memory: [mem 0x7eab9000-0x7eabafff]
[    0.032812] PM: hibernation: Registered nosave memory: [mem 0x7eabb000-0x7eac2fff]
[    0.032813] PM: hibernation: Registered nosave memory: [mem 0x7eac3000-0x7eadafff]
[    0.032814] PM: hibernation: Registered nosave memory: [mem 0x7eafb000-0x7eb1afff]
[    0.032815] PM: hibernation: Registered nosave memory: [mem 0x7ed1c000-0x7ed3ffff]
[    0.032817] PM: hibernation: Registered nosave memory: [mem 0x7fb9b000-0x7fbcafff]
[    0.032817] PM: hibernation: Registered nosave memory: [mem 0x7fbcb000-0x7fbf2fff]
[    0.032818] PM: hibernation: Registered nosave memory: [mem 0x7fbf3000-0x7fbfafff]
[    0.032818] PM: hibernation: Registered nosave memory: [mem 0x7fbfb000-0x7fbfefff]
[    0.032819] PM: hibernation: Registered nosave memory: [mem 0x7ff20000-0x7ff3ffff]
[    0.032820] PM: hibernation: Registered nosave memory: [mem 0x7ff40000-0x7fffffff]
[    0.032820] PM: hibernation: Registered nosave memory: [mem 0x80000000-0xafffffff]
[    0.032821] PM: hibernation: Registered nosave memory: [mem 0xb0000000-0xbfffffff]
[    0.032821] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xffdfffff]
[    0.032822] PM: hibernation: Registered nosave memory: [mem 0xffe00000-0xffffffff]
[    0.032823] [mem 0xc0000000-0xffdfffff] available for PCI devices
[    0.032826] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.036174] setup_percpu: NR_CPUS:320 nr_cpumask_bits:320 nr_cpu_ids:8 nr_node_ids:1
[    0.036486] percpu: Embedded 54 pages/cpu s184320 r8192 d28672 u262144
[    0.036492] pcpu-alloc: s184320 r8192 d28672 u262144 alloc=1*2097152
[    0.036494] pcpu-alloc: [0] 0 1 2 3 4 5 6 7 
[    0.036513] Built 1 zonelists, mobility grouping on.  Total pages: 4126076
[    0.036514] Policy zone: Normal
[    0.036515] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-linux-custom root=UUID=86913e9d-18bf-48c5-9257-4c0c9a470aa6 rw loglevel=3 quiet audit=0
[    0.036562] audit: disabled (until reboot)
[    0.038258] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.039135] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)
[    0.039173] mem auto-init: stack:byref_all(zero), heap alloc:on, heap free:off
[    0.076831] Memory: 16348312K/16774208K available (14346K kernel code, 2080K rwdata, 9112K rodata, 1524K init, 4372K bss, 425636K reserved, 0K cma-reserved)
[    0.076839] random: get_random_u64 called from __kmem_cache_create+0x2a/0x560 with crng_init=0
[    0.076934] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1
[    0.076945] ftrace: allocating 42292 entries in 166 pages
[    0.086556] ftrace: allocated 166 pages with 4 groups
[    0.086639] rcu: Hierarchical RCU implementation.
[    0.086639] rcu: 	RCU dyntick-idle grace-period acceleration is enabled.
[    0.086640] rcu: 	RCU restricting CPUs from NR_CPUS=320 to nr_cpu_ids=8.
[    0.086641] 	Rude variant of Tasks RCU enabled.
[    0.086641] 	Tracing variant of Tasks RCU enabled.
[    0.086641] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.086642] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8
[    0.088881] NR_IRQS: 20736, nr_irqs: 488, preallocated irqs: 16
[    0.089185] Console: colour dummy device 80x25
[    0.089193] printk: console [tty0] enabled
[    0.089206] ACPI: Core revision 20210105
[    0.089303] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.089356] APIC: Switch to symmetric I/O mode setup
[    0.089434] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.090003] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.139389] tsc: Marking TSC unstable due to TSCs unsynchronized
[    0.139391] Calibrating delay loop (skipped), value calculated using timer frequency.. 6987.05 BogoMIPS (lpj=34935250)
[    0.139393] pid_max: default: 32768 minimum: 301
[    0.139919] LSM: Security Framework initializing
[    0.139922] Yama: becoming mindful.
[    0.139957] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.139985] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.140157] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.140207] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127
[    0.140208] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0
[    0.140211] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.140213] Spectre V2 : Mitigation: Full AMD retpoline
[    0.140213] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.140214] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.140215] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.140365] Freeing SMP alternatives memory: 36K
[    0.140428] smpboot: CPU0: AMD Ryzen Threadripper PRO 3975WX 32-Cores (family: 0x17, model: 0x31, stepping: 0x0)
[    0.140496] Performance Events: Fam17h+ core perfctr, AMD PMU driver.
[    0.140505] ... version:                0
[    0.140506] ... bit width:              48
[    0.140506] ... generic registers:      6
[    0.140507] ... value mask:             0000ffffffffffff
[    0.140507] ... max period:             00007fffffffffff
[    0.140508] ... fixed-purpose events:   0
[    0.140508] ... event mask:             000000000000003f
[    0.140545] rcu: Hierarchical SRCU implementation.
[    0.140901] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    0.149451] smp: Bringing up secondary CPUs ...
[    0.149523] x86: Booting SMP configuration:
[    0.149523] .... node  #0, CPUs:      #1 #2 #3 #4 #5 #6 #7
[    1.199500] smp: Brought up 1 node, 8 CPUs
[    1.199502] smpboot: Max logical packages: 1
[    1.199502] smpboot: Total of 8 processors activated (55908.49 BogoMIPS)
[    1.200307] devtmpfs: initialized
[    1.200307] x86/mm: Memory block size: 128MB
[    1.200307] PM: Registering ACPI NVS region [mem 0x00800000-0x00807fff] (32768 bytes)
[    1.200307] PM: Registering ACPI NVS region [mem 0x00810000-0x008fffff] (983040 bytes)
[    1.200307] PM: Registering ACPI NVS region [mem 0x7eab5000-0x7eab8fff] (16384 bytes)
[    1.200307] PM: Registering ACPI NVS region [mem 0x7eabb000-0x7eac2fff] (32768 bytes)
[    1.200307] PM: Registering ACPI NVS region [mem 0x7fbfb000-0x7fbfefff] (16384 bytes)
[    1.200307] PM: Registering ACPI NVS region [mem 0x7ff40000-0x7fffffff] (786432 bytes)
[    1.200307] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    1.200307] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[    1.200307] pinctrl core: initialized pinctrl subsystem
[    1.200307] PM: RTC time: 16:56:47, date: 2021-07-12
[    1.200307] NET: Registered protocol family 16
[    1.200307] DMA: preallocated 2048 KiB GFP_KERNEL pool for atomic allocations
[    1.200307] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    1.200307] DMA: preallocated 2048 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    1.200349] thermal_sys: Registered thermal governor 'fair_share'
[    1.200350] thermal_sys: Registered thermal governor 'bang_bang'
[    1.200351] thermal_sys: Registered thermal governor 'step_wise'
[    1.200351] thermal_sys: Registered thermal governor 'user_space'
[    1.200352] thermal_sys: Registered thermal governor 'power_allocator'
[    1.200359] cpuidle: using governor ladder
[    1.200361] cpuidle: using governor menu
[    1.200589] ACPI: bus type PCI registered
[    1.200589] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.200589] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xb0000000-0xbfffffff] (base 0xb0000000)
[    1.200589] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[    1.200589] PCI: Using configuration type 1 for base access
[    1.200589] Kprobes globally optimized
[    1.200589] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    1.200589] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.200589] ACPI: Added _OSI(Module Device)
[    1.200589] ACPI: Added _OSI(Processor Device)
[    1.200589] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.200589] ACPI: Added _OSI(Processor Aggregator Device)
[    1.200589] ACPI: Added _OSI(Linux-Dell-Video)
[    1.200589] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    1.200589] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    1.200637] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    1.201079] ACPI: Interpreter enabled
[    1.201089] ACPI: (supports S0 S3 S4 S5)
[    1.201089] ACPI: Using IOAPIC for interrupt routing
[    1.201101] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.201167] ACPI: Enabled 1 GPEs in block 00 to 3F
[    1.202616] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    1.202620] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    1.202689] acpi PNP0A08:00: _OSC: platform does not support [LTR DPC]
[    1.202749] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME AER PCIeCapability]
[    1.202845] PCI host bridge to bus 0000:00
[    1.202846] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    1.202848] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    1.202849] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.202850] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]
[    1.202851] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    1.202851] pci_bus 0000:00: root bus resource [mem 0x800000000-0xfffffffff window]
[    1.202852] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.202875] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[    1.203061] pci 0000:00:01.0: [8086:100e] type 00 class 0x020000
[    1.203707] pci 0000:00:01.0: reg 0x10: [mem 0xc0140000-0xc015ffff]
[    1.209674] pci 0000:00:01.0: reg 0x14: [io  0x6140-0x617f]
[    1.212217] pci 0000:00:01.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    1.212333] pci 0000:00:02.0: [1b36:0010] type 00 class 0x010802
[    1.212566] pci 0000:00:02.0: reg 0x10: [mem 0x810300000-0x810303fff 64bit]
[    1.213785] pci 0000:00:03.0: [1022:148c] type 00 class 0x0c0330
[    1.214439] pci 0000:00:03.0: reg 0x10: [mem 0x810200000-0x8102fffff 64bit]
[    1.216957] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    1.217175] pci 0000:00:04.0: [1002:73bf] type 00 class 0x030000
[    1.219403] pci 0000:00:04.0: reg 0x10: [mem 0x800000000-0x80fffffff 64bit pref]
[    1.226418] pci 0000:00:04.0: reg 0x18: [mem 0x810000000-0x8101fffff 64bit pref]
[    1.229395] pci 0000:00:04.0: reg 0x20: [io  0x6000-0x60ff]
[    1.235519] pci 0000:00:04.0: reg 0x24: [mem 0xc0000000-0xc00fffff]
[    1.239393] pci 0000:00:04.0: reg 0x30: [mem 0xfffe0000-0xffffffff pref]
[    1.239679] pci 0000:00:04.0: BAR 0: assigned to efifb
[    1.239791] pci 0000:00:04.0: PME# supported from D1 D2 D3hot D3cold
[    1.239935] pci 0000:00:05.0: [1002:ab28] type 00 class 0x040300
[    1.240272] pci 0000:00:05.0: reg 0x10: [mem 0xc0160000-0xc0163fff]
[    1.242061] pci 0000:00:05.0: PME# supported from D1 D2 D3hot D3cold
[    1.242236] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[    1.242409] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    1.242514] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[    1.244072] pci 0000:00:1f.2: reg 0x20: [io  0x6180-0x619f]
[    1.244367] pci 0000:00:1f.2: reg 0x24: [mem 0xc0164000-0xc0164fff]
[    1.244790] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[    1.245642] pci 0000:00:1f.3: reg 0x20: [io  0x6100-0x613f]
[    1.246237] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    1.246292] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    1.246343] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    1.246393] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    1.246445] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[    1.249447] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[    1.259497] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[    1.271276] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[    1.271317] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[    1.271332] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[    1.271347] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[    1.271360] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[    1.271374] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[    1.271387] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[    1.271400] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[    1.271413] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[    1.271980] iommu: Default domain type: Translated 
[    1.272011] pci 0000:00:04.0: vgaarb: setting as boot VGA device
[    1.272011] pci 0000:00:04.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    1.272011] pci 0000:00:04.0: vgaarb: bridge control possible
[    1.272011] vgaarb: loaded
[    1.272011] SCSI subsystem initialized
[    1.272011] libata version 3.00 loaded.
[    1.272011] ACPI: bus type USB registered
[    1.272011] usbcore: registered new interface driver usbfs
[    1.272011] usbcore: registered new interface driver hub
[    1.272011] usbcore: registered new device driver usb
[    1.272011] pps_core: LinuxPPS API ver. 1 registered
[    1.272011] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[    1.272011] PTP clock support registered
[    1.272011] EDAC MC: Ver: 3.0.0
[    1.272011] Registered efivars operations
[    1.272011] NetLabel: Initializing
[    1.272011] NetLabel:  domain hash size = 128
[    1.272011] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.272011] NetLabel:  unlabeled traffic allowed by default
[    1.272011] PCI: Using ACPI for IRQ routing
[    1.317785] PCI: pci_cache_line_size set to 64 bytes
[    1.317906] e820: reserve RAM buffer [mem 0x00810000-0x008fffff]
[    1.317908] e820: reserve RAM buffer [mem 0x7e571000-0x7fffffff]
[    1.317911] e820: reserve RAM buffer [mem 0x7e9f4000-0x7fffffff]
[    1.317914] e820: reserve RAM buffer [mem 0x7eab5000-0x7fffffff]
[    1.317916] e820: reserve RAM buffer [mem 0x7eafb000-0x7fffffff]
[    1.317918] e820: reserve RAM buffer [mem 0x7ed1c000-0x7fffffff]
[    1.317920] e820: reserve RAM buffer [mem 0x7fb9b000-0x7fffffff]
[    1.317921] e820: reserve RAM buffer [mem 0x7ff20000-0x7fffffff]
[    1.317934] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    1.317934] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    1.320918] clocksource: Switched to clocksource hpet
[    1.328159] VFS: Disk quotas dquot_6.6.0
[    1.328175] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.328236] pnp: PnP ACPI init
[    1.328278] pnp 00:00: Plug and Play ACPI device, IDs PNP0303 (active)
[    1.328297] pnp 00:01: Plug and Play ACPI device, IDs PNP0f13 (active)
[    1.328313] pnp 00:02: Plug and Play ACPI device, IDs PNP0400 (active)
[    1.328330] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.328344] pnp 00:04: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.328387] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved
[    1.328392] system 00:05: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.328669] pnp: PnP ACPI: found 6 devices
[    1.336521] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.336581] NET: Registered protocol family 2
[    1.336781] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    1.338397] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes, linear)
[    1.338506] TCP established hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    1.338712] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear)
[    1.338824] TCP: Hash tables configured (established 131072 bind 65536)
[    1.338902] MPTCP token hash table entries: 16384 (order: 6, 393216 bytes, linear)
[    1.338959] UDP hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    1.339010] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    1.339157] NET: Registered protocol family 1
[    1.339162] NET: Registered protocol family 44
[    1.339165] pci 0000:00:01.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[    1.339168] pci 0000:00:04.0: can't claim BAR 6 [mem 0xfffe0000-0xffffffff pref]: no compatible bridge window
[    1.339175] pci 0000:00:01.0: BAR 6: assigned [mem 0x80000000-0x8003ffff pref]
[    1.339178] pci 0000:00:04.0: BAR 6: assigned [mem 0x80040000-0x8005ffff pref]
[    1.339181] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    1.339183] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    1.339185] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    1.339186] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]
[    1.339188] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    1.339189] pci_bus 0000:00: resource 9 [mem 0x800000000-0xfffffffff window]
[    1.339568] PCI Interrupt Link [GSIF] enabled at IRQ 21
[    1.340131] pci 0000:00:04.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    1.340176] PCI: CLS 64 bytes, default 64
[    1.340216] Trying to unpack rootfs image as initramfs...
[    1.383656] Freeing initrd memory: 8000K
[    1.383663] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    1.383664] software IO TLB: mapped [mem 0x0000000077efe000-0x000000007befe000] (64MB)
[    1.384316] kvm: Nested Virtualization enabled
[    1.384317] SVM: kvm: Nested Paging enabled
[    1.408791] Initialise system trusted keyrings
[    1.408807] Key type blacklist registered
[    1.408942] workingset: timestamp_bits=41 max_order=22 bucket_order=0
[    1.410176] zbud: loaded
[    1.415274] Key type asymmetric registered
[    1.415276] Asymmetric key parser 'x509' registered
[    1.415283] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    1.415404] io scheduler mq-deadline registered
[    1.415406] io scheduler kyber registered
[    1.415426] io scheduler bfq registered
[    1.416015] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.416040] efifb: probing for efifb
[    1.416062] efifb: showing boot graphics
[    1.417381] efifb: framebuffer at 0x800000000, using 1984k, total 1984k
[    1.417383] efifb: mode is 800x600x32, linelength=3328, pages=1
[    1.417384] efifb: scrolling: redraw
[    1.417385] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    1.417470] fbcon: Deferring console take-over
[    1.417471] fb0: EFI VGA frame buffer device
[    1.417543] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    1.417591] ACPI: button: Power Button [PWRF]
[    1.418174] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.418419] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.421491] Non-volatile memory driver v1.3
[    1.421493] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <[email protected]>
[    1.421494] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[    1.423028] nvme nvme0: pci function 0000:00:02.0
[    1.423064] ahci 0000:00:1f.2: version 3.0
[    1.423813] PCI Interrupt Link [GSIG] enabled at IRQ 22
[    1.423839] PCI Interrupt Link [GSIA] enabled at IRQ 16
[    1.424410] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[    1.424415] ahci 0000:00:1f.2: flags: 64bit ncq only 
[    1.425472] scsi host0: ahci
[    1.425794] scsi host1: ahci
[    1.426249] scsi host2: ahci
[    1.426701] scsi host3: ahci
[    1.427245] scsi host4: ahci
[    1.427460] nvme nvme0: 8/0/0 default/read/poll queues
[    1.427608] scsi host5: ahci
[    1.427657] ata1: SATA max UDMA/133 abar [email protected] port 0xc0164100 irq 25
[    1.427663] ata2: SATA max UDMA/133 abar [email protected] port 0xc0164180 irq 25
[    1.427668] ata3: SATA max UDMA/133 abar [email protected] port 0xc0164200 irq 25
[    1.427673] ata4: SATA max UDMA/133 abar [email protected] port 0xc0164280 irq 25
[    1.427678] ata5: SATA max UDMA/133 abar [email protected] port 0xc0164300 irq 25
[    1.427683] ata6: SATA max UDMA/133 abar [email protected] port 0xc0164380 irq 25
[    1.427715] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.427719] ehci-pci: EHCI PCI platform driver
[    1.427727] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.427729] ohci-pci: OHCI PCI platform driver
[    1.427734] uhci_hcd: USB Universal Host Controller Interface driver
[    1.427764] usbcore: registered new interface driver usbserial_generic
[    1.427768] usbserial: USB Serial support registered for generic
[    1.427931] rtc_cmos 00:04: RTC can wake from S4
[    1.428398] rtc_cmos 00:04: registered as rtc0
[    1.428519] rtc_cmos 00:04: setting system clock to 2021-07-12T16:56:48 UTC (1626109008)
[    1.428535] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    1.428978] ledtrig-cpu: registered to indicate activity on CPUs
[    1.429038] hid: raw HID events driver (C) Jiri Kosina
[    1.429082] drop_monitor: Initializing network drop monitor service
[    1.429150] Initializing XFRM netlink socket
[    1.429247] NET: Registered protocol family 10
[    1.429341]  nvme0n1: p1 p2
[    1.433613] Segment Routing with IPv6
[    1.433615] RPL Segment Routing with IPv6
[    1.433634] NET: Registered protocol family 17
[    1.434496] IPI shorthand broadcast: enabled
[    1.434609] registered taskstats version 1
[    1.434617] Loading compiled-in X.509 certificates
[    1.437688] Loaded X.509 cert 'Build time autogenerated kernel key: 68dadd91ffeedaa8acf32e00420b517f384bdd01'
[    1.438250] zswap: loaded using pool lz4/z3fold
[    1.438659] Key type ._fscrypt registered
[    1.438661] Key type .fscrypt registered
[    1.438662] Key type fscrypt-provisioning registered
[    1.438987] PM:   Magic number: 13:495:944
[    1.439012] tty tty1: hash matches
[    1.439231] RAS: Correctable Errors collector initialized.
[    1.439239] Unstable clock detected, switching default tracing clock to "global"
               If you want to keep using the local clock, then add:
                 "trace_clock=local"
               on the kernel command line
[    1.751761] ata2: SATA link down (SStatus 0 SControl 300)
[    1.752294] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    1.752364] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[    1.752369] ata3.00: applying bridge limits
[    1.752449] ata3.00: configured for UDMA/100
[    1.752601] ata1: SATA link down (SStatus 0 SControl 300)
[    1.753064] scsi 2:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
[    1.762069] ata5: SATA link down (SStatus 0 SControl 300)
[    1.762445] ata4: SATA link down (SStatus 0 SControl 300)
[    1.762539] ata6: SATA link down (SStatus 0 SControl 300)
[    1.763927] Freeing unused decrypted memory: 2044K
[    1.764222] Freeing unused kernel image (initmem) memory: 1524K
[    1.799548] Write protecting the kernel read-only data: 26624k
[    1.800205] Freeing unused kernel image (text/rodata gap) memory: 2036K
[    1.800516] Freeing unused kernel image (rodata/data gap) memory: 1128K
[    1.844043] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.844048] rodata_test: all tests were successful
[    1.844053] Run /init as init process
[    1.844054]   with arguments:
[    1.844055]     /init
[    1.844056]   with environment:
[    1.844057]     HOME=/
[    1.844058]     TERM=linux
[    1.844059]     BOOT_IMAGE=/boot/vmlinuz-linux-custom
[    1.861877] fbcon: Taking over console
[    1.861945] Console: switching to colour frame buffer device 100x37
[    1.926358] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    1.927283] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.927292] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.928519] xhci_hcd 0000:00:03.0: xHCI Host Controller
[    1.928528] xhci_hcd 0000:00:03.0: new USB bus registered, assigned bus number 1
[    1.928665] xhci_hcd 0000:00:03.0: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000000000410
[    1.970927] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.12
[    1.970932] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.970934] usb usb1: Product: xHCI Host Controller
[    1.970936] usb usb1: Manufacturer: Linux 5.12.14-arch1-1-custom xhci-hcd
[    1.970938] usb usb1: SerialNumber: 0000:00:03.0
[    1.971150] hub 1-0:1.0: USB hub found
[    1.971158] hub 1-0:1.0: 2 ports detected
[    1.971310] xhci_hcd 0000:00:03.0: xHCI Host Controller
[    1.971314] xhci_hcd 0000:00:03.0: new USB bus registered, assigned bus number 2
[    1.971317] xhci_hcd 0000:00:03.0: Host supports USB 3.1 Enhanced SuperSpeed
[    1.971333] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    1.971355] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.12
[    1.971357] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.971359] usb usb2: Product: xHCI Host Controller
[    1.971360] usb usb2: Manufacturer: Linux 5.12.14-arch1-1-custom xhci-hcd
[    1.971362] usb usb2: SerialNumber: 0000:00:03.0
[    1.971509] hub 2-0:1.0: USB hub found
[    1.971516] hub 2-0:1.0: 2 ports detected
[    1.989707] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    1.989711] cdrom: Uniform CD-ROM driver Revision: 3.20
[    1.994908] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    2.199796] sr 2:0:0:0: Attached scsi CD-ROM sr0
[    2.259443] usb 1-2: new high-speed USB device number 2 using xhci_hcd
[    2.463858] usb 1-2: New USB device found, idVendor=0bda, idProduct=5411, bcdDevice= 1.21
[    2.463863] usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.463865] usb 1-2: Product: 4-Port USB 2.0 Hub
[    2.463867] usb 1-2: Manufacturer: Generic
[    2.516161] hub 1-2:1.0: USB hub found
[    2.518359] hub 1-2:1.0: 4 ports detected
[    2.861805] EXT4-fs (nvme0n1p2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[    2.899450] usb 1-2.3: new full-speed USB device number 3 using xhci_hcd
[    2.902636] random: fast init done
[    3.000489] systemd[1]: systemd 249-2-arch running in system mode (+PAM +AUDIT -SELINUX -APPARMOR -IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +XKBCOMMON +UTMP -SYSVINIT default-hierarchy=unified)
[    3.000558] systemd[1]: Detected virtualization qemu.
[    3.000566] systemd[1]: Detected architecture x86-64.
[    3.001461] systemd[1]: Hostname set to <vm2>.
[    3.039486] random: lvmconfig: uninitialized urandom read (4 bytes read)
[    3.049445] usb 1-2.3: New USB device found, idVendor=24ae, idProduct=2010, bcdDevice= 1.10
[    3.049451] usb 1-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    3.049453] usb 1-2.3: Product: Rapoo 2.4G Wireless Device
[    3.049455] usb 1-2.3: Manufacturer: RAPOO
[    3.119338] systemd[1]: Queued start job for default target Graphical Interface.
[    3.120466] systemd[1]: Created slice Slice /system/getty.
[    3.120746] systemd[1]: Created slice Slice /system/modprobe.
[    3.120969] systemd[1]: Created slice User and Session Slice.
[    3.121055] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    3.121126] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    3.121274] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    3.121352] systemd[1]: Reached target Local Encrypted Volumes.
[    3.121412] systemd[1]: Reached target Host and Network Name Lookups.
[    3.121452] systemd[1]: Reached target Path Units.
[    3.121494] systemd[1]: Reached target Remote File Systems.
[    3.121538] systemd[1]: Reached target Slice Units.
[    3.121584] systemd[1]: Reached target Swaps.
[    3.121631] systemd[1]: Reached target Local Verity Integrity Protected Volumes.
[    3.121712] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[    3.121824] systemd[1]: Listening on LVM2 poll daemon socket.
[    3.124771] systemd[1]: Listening on RPCbind Server Activation Socket.
[    3.124805] systemd[1]: Reached target RPC Port Mapper.
[    3.125493] systemd[1]: Listening on Process Core Dump Socket.
[    3.127721] systemd[1]: Condition check resulted in Journal Audit Socket being skipped.
[    3.127793] systemd[1]: Listening on Journal Socket (/dev/log).
[    3.127856] systemd[1]: Listening on Journal Socket.
[    3.128093] systemd[1]: Listening on udev Control Socket.
[    3.128159] systemd[1]: Listening on udev Kernel Socket.
[    3.128677] systemd[1]: Mounting Huge Pages File System...
[    3.129119] systemd[1]: Mounting POSIX Message Queue File System...
[    3.129605] systemd[1]: Mounting NFSD configuration filesystem...
[    3.130122] systemd[1]: Mounting Kernel Debug File System...
[    3.130701] systemd[1]: Mounting Kernel Trace File System...
[    3.131365] systemd[1]: Mounting Temporary Directory /tmp...
[    3.131413] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped.
[    3.131972] systemd[1]: Starting Create List of Static Device Nodes...
[    3.132493] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
[    3.133069] systemd[1]: Starting Load Kernel Module configfs...
[    3.133605] systemd[1]: Starting Load Kernel Module drm...
[    3.134173] systemd[1]: Starting Load Kernel Module fuse...
[    3.134675] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[    3.134700] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[    3.135299] random: lvm: uninitialized urandom read (4 bytes read)
[    3.136078] systemd[1]: Starting Journal Service...
[    3.137091] systemd[1]: Starting Load Kernel Modules...
[    3.137632] systemd[1]: Starting Remount Root and Kernel File Systems...
[    3.137676] systemd[1]: Condition check resulted in Repartition Root Disk being skipped.
[    3.138251] systemd[1]: Starting Coldplug All udev Devices...
[    3.139260] systemd[1]: Mounted Huge Pages File System.
[    3.139350] systemd[1]: Mounted POSIX Message Queue File System.
[    3.139467] systemd[1]: Mounted Kernel Debug File System.
[    3.139529] systemd[1]: Mounted Kernel Trace File System.
[    3.139595] systemd[1]: Mounted Temporary Directory /tmp.
[    3.139870] systemd[1]: Finished Create List of Static Device Nodes.
[    3.140395] Linux agpgart interface v0.103
[    3.141794] systemd[1]: [email protected]: Deactivated successfully.
[    3.142204] systemd[1]: Finished Load Kernel Module configfs.
[    3.143130] EXT4-fs (nvme0n1p2): re-mounted. Opts: (null). Quota mode: none.
[    3.143684] systemd[1]: Mounting Kernel Configuration File System...
[    3.145505] systemd[1]: Mounted Kernel Configuration File System.
[    3.147335] sr 2:0:0:0: Attached scsi generic sg0 type 5
[    3.148149] systemd[1]: Finished Remount Root and Kernel File Systems.
[    3.148592] systemd[1]: Finished Load Kernel Modules.
[    3.149339] systemd[1]: Condition check resulted in First Boot Wizard being skipped.
[    3.150398] fuse: init (API version 7.33)
[    3.150449] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[    3.151412] systemd[1]: Starting Load/Save Random Seed...
[    3.152169] systemd[1]: Starting Apply Kernel Variables...
[    3.152231] systemd[1]: Condition check resulted in Create System Users being skipped.
[    3.152971] systemd[1]: Starting Create Static Device Nodes in /dev...
[    3.153429] systemd[1]: [email protected]: Deactivated successfully.
[    3.153823] systemd[1]: Finished Load Kernel Module fuse.
[    3.154744] systemd[1]: Mounting FUSE Control File System...
[    3.157173] systemd[1]: Finished Apply Kernel Variables.
[    3.157336] systemd[1]: Mounted FUSE Control File System.
[    3.180157] systemd[1]: Started Journal Service.
[    3.184579] systemd-journald[241]: Received client request to flush runtime journal.
[    3.189960] RPC: Registered named UNIX socket transport module.
[    3.189962] RPC: Registered udp transport module.
[    3.189963] RPC: Registered tcp transport module.
[    3.189964] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    3.232724] Installing knfsd (copyright (C) 1996 [email protected]).
[    3.259419] usb 1-2.4: new full-speed USB device number 4 using xhci_hcd
[    3.260538] input: RAPOO Rapoo 2.4G Wireless Device as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.3/1-2.3:1.0/0003:24AE:2010.0001/input/input3
[    3.260709] hid-generic 0003:24AE:2010.0001: input,hidraw0: USB HID v1.10 Mouse [RAPOO Rapoo 2.4G Wireless Device] on usb-0000:00:03.0-2.3/input0
[    3.262450] parport_pc 00:02: reported by Plug and Play ACPI
[    3.262560] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
[    3.265168] input: RAPOO Rapoo 2.4G Wireless Device System Control as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.3/1-2.3:1.1/0003:24AE:2010.0002/input/input5
[    3.270810] e1000: Intel(R) PRO/1000 Network Driver
[    3.270814] e1000: Copyright (c) 1999-2006 Intel Corporation.
[    3.271916] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[    3.274898] i801_smbus 0000:00:1f.3: Enabling SMBus device
[    3.274944] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    3.275006] i2c i2c-0: 1/1 memory slots populated (from DMI)
[    3.275007] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[    3.323391] input: PC Speaker as /devices/platform/pcspkr/input/input7
[    3.328065] iTCO_vendor_support: vendor-support=0
[    3.329721] input: RAPOO Rapoo 2.4G Wireless Device Consumer Control as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.3/1-2.3:1.1/0003:24AE:2010.0002/input/input6
[    3.329903] hid-generic 0003:24AE:2010.0002: input,hiddev96,hidraw1: USB HID v1.10 Device [RAPOO Rapoo 2.4G Wireless Device] on usb-0000:00:03.0-2.3/input1
[    3.331749] iTCO_wdt iTCO_wdt.1.auto: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)
[    3.331880] iTCO_wdt iTCO_wdt.1.auto: initialized. heartbeat=30 sec (nowayout=0)
[    3.333595] input: RAPOO Rapoo 2.4G Wireless Device as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.3/1-2.3:1.2/0003:24AE:2010.0003/input/input9
[    3.353091] ppdev: user-space parallel port driver
[    3.355044] snd_hda_intel 0000:00:05.0: Force to non-snoop mode
[    3.399751] hid-generic 0003:24AE:2010.0003: input,hidraw2: USB HID v1.10 Keyboard [RAPOO Rapoo 2.4G Wireless Device] on usb-0000:00:03.0-2.3/input2
[    3.399819] usbcore: registered new interface driver usbhid
[    3.399821] usbhid: USB HID core driver
[    3.412249] input: HDA ATI HDMI HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:05.0/sound/card0/input10
[    3.412313] input: HDA ATI HDMI HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:05.0/sound/card0/input11
[    3.412360] input: HDA ATI HDMI HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:05.0/sound/card0/input12
[    3.412403] input: HDA ATI HDMI HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:05.0/sound/card0/input13
[    3.412808] input: HDA ATI HDMI HDMI/DP,pcm=10 as /devices/pci0000:00/0000:00:05.0/sound/card0/input14
[    3.412905] input: HDA ATI HDMI HDMI/DP,pcm=11 as /devices/pci0000:00/0000:00:05.0/sound/card0/input15
[    3.439421] usb 1-2.4: New USB device found, idVendor=046d, idProduct=c534, bcdDevice=29.01
[    3.439425] usb 1-2.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    3.439428] usb 1-2.4: Product: USB Receiver
[    3.439429] usb 1-2.4: Manufacturer: Logitech
[    3.516625] input: Logitech USB Receiver as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.0/0003:046D:C534.0004/input/input16
[    3.579736] hid-generic 0003:046D:C534.0004: input,hidraw3: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:00:03.0-2.4/input0
[    3.583745] input: Logitech USB Receiver Mouse as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/input/input17
[    3.583873] input: Logitech USB Receiver Consumer Control as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/input/input18
[    3.649590] input: Logitech USB Receiver System Control as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/input/input19
[    3.649834] hid-generic 0003:046D:C534.0005: input,hiddev97,hidraw4: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:00:03.0-2.4/input1
[    3.679170] e1000 0000:00:01.0 eth0: (PCI:33MHz:32-bit) 00:25:4b:00:00:02
[    3.679176] e1000 0000:00:01.0 eth0: Intel(R) PRO/1000 Network Connection
[    3.754499] cryptd: max_cpu_qlen set to 1000
[    3.755067] e1000 0000:00:01.0 enp0s1: renamed from eth0
[    3.757937] FAT-fs (nvme0n1p1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[    3.766792] AVX2 version of gcm_enc/dec engaged.
[    3.766977] AES CTR mode by8 optimization enabled
[    3.838016] random: dbus-daemon: uninitialized urandom read (12 bytes read)
[    3.990305] [drm] amdgpu kernel modesetting enabled.
[    3.990335] Decoding supported only on Scalable MCA processors.
[    3.990467] CRAT table not found
[    3.990470] Virtual CRAT table created for CPU
[    3.990498] amdgpu: Topology: Add CPU node
[    3.990572] checking generic (800000000 1f0000) vs hw (800000000 10000000)
[    3.990575] fb0: switching to amdgpudrmfb from EFI VGA
[    3.991045] Console: switching to colour dummy device 80x25
[    3.991094] amdgpu 0000:00:04.0: vgaarb: deactivate vga console
[    3.991523] PCI Interrupt Link [GSIE] enabled at IRQ 20
[    3.991560] [drm] initializing kernel modesetting (SIENNA_CICHLID 0x1002:0x73BF 0x1849:0x5212 0xC0).
[    3.991564] amdgpu 0000:00:04.0: amdgpu: Trusted Memory Zone (TMZ) feature not supported
[    3.991574] [drm] register mmio base: 0xC0000000
[    3.991575] [drm] register mmio size: 1048576
[    3.991577] [drm] PCIE atomic ops is not supported
[    3.993306] [drm] add ip block number 0 <nv_common>
[    3.993308] [drm] add ip block number 1 <gmc_v10_0>
[    3.993309] [drm] add ip block number 2 <navi10_ih>
[    3.993319] [drm] add ip block number 3 <psp>
[    3.993321] [drm] add ip block number 4 <smu>
[    3.993322] [drm] add ip block number 5 <dm>
[    3.993323] [drm] add ip block number 6 <gfx_v10_0>
[    3.993325] [drm] add ip block number 7 <sdma_v5_2>
[    3.993326] [drm] add ip block number 8 <vcn_v3_0>
[    3.993327] [drm] add ip block number 9 <jpeg_v3_0>
[    3.993330] kfd kfd: skipped device 1002:73bf, PCI rejects atomics
[    3.993349] amdgpu 0000:00:04.0: amdgpu: Fetched VBIOS from VFCT
[    3.993351] amdgpu: ATOM BIOS: 113-EXT800216-L05
[    3.993379] [drm] VCN(0) decode is enabled in VM mode
[    3.993381] [drm] VCN(1) decode is enabled in VM mode
[    3.993382] [drm] VCN(0) encode is enabled in VM mode
[    3.993383] [drm] VCN(1) encode is enabled in VM mode
[    3.993385] [drm] JPEG decode is enabled in VM mode
[    3.993419] amdgpu 0000:00:04.0: amdgpu: HBM ECC is not presented.
[    3.993421] amdgpu 0000:00:04.0: amdgpu: SRAM ECC is not presented.
[    3.993424] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    3.996533] amdgpu 0000:00:04.0: BAR 2: releasing [mem 0x810000000-0x8101fffff 64bit pref]
[    3.996541] amdgpu 0000:00:04.0: BAR 0: releasing [mem 0x800000000-0x80fffffff 64bit pref]
[    3.996564] amdgpu 0000:00:04.0: BAR 0: assigned [mem 0x800000000-0x80fffffff 64bit pref]
[    3.996648] amdgpu 0000:00:04.0: BAR 2: assigned [mem 0x810000000-0x8101fffff 64bit pref]
[    4.005808] amdgpu 0000:00:04.0: amdgpu: VRAM: 16368M 0x0000008000000000 - 0x00000083FEFFFFFF (16368M used)
[    4.005813] amdgpu 0000:00:04.0: amdgpu: GART: 512M 0x0000000000000000 - 0x000000001FFFFFFF
[    4.005815] amdgpu 0000:00:04.0: amdgpu: AGP: 267894784M 0x0000008400000000 - 0x0000FFFFFFFFFFFF
[    4.005844] [drm] Detected VRAM RAM=16368M, BAR=256M
[    4.005846] [drm] RAM width 256bits GDDR6
[    4.006015] [TTM] Zone  kernel: Available graphics memory: 8193256 KiB
[    4.006018] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[    4.006070] [drm] amdgpu: 16368M of VRAM memory ready
[    4.006074] [drm] amdgpu: 12001M of GTT memory ready.
[    4.006076] [drm] GART: num cpu pages 131072, num gpu pages 131072
[    4.006250] [drm] PCIE GART of 512M enabled (table at 0x00000080001E8000).
[    4.045587] 8021q: 802.1Q VLAN Support v1.8
[    4.090049] mousedev: PS/2 mouse device common for all mice
[    4.090053] logitech-djreceiver 0003:046D:C534.0004: hidraw3: USB HID v1.11 Keyboard [Logitech USB Receiver] on usb-0000:00:03.0-2.4/input0
[    4.410390] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input8
[    5.775970] [drm] Loading DMUB firmware via PSP: version=0x00000000
[    5.782178] [drm] use_doorbell being set to: [true]
[    5.782438] [drm] use_doorbell being set to: [true]
[    5.782589] [drm] use_doorbell being set to: [true]
[    5.782733] [drm] use_doorbell being set to: [true]
[    5.783609] [drm] Found VCN firmware Version ENC: 1.13 DEC: 2 VEP: 0 Revision: 20
[    5.783624] [drm] PSP loading VCN firmware
[    5.967014] [drm] reserve 0xa00000 from 0x83fe000000 for PSP TMR
[    6.085537] amdgpu 0000:00:04.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
[    6.085566] amdgpu 0000:00:04.0: amdgpu: use vbios provided pptable
[    6.180577] amdgpu 0000:00:04.0: amdgpu: SMU is initialized successfully!
[    6.186789] [drm] Display Core initialized with v3.2.122!
[    6.205580] [drm] DMUB hardware initialized: version=0x02000018
[    6.519668] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[    7.709430] random: crng init done
[    7.709431] random: 2 urandom warning(s) missed due to ratelimiting
[   10.839687] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[   15.159673] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[   17.179103] [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:480
[   17.206745] snd_hda_intel 0000:00:05.0: bound 0000:00:04.0 (ops amdgpu_dm_audio_component_bind_ops [amdgpu])
[   17.321137] Decoding supported only on Scalable MCA processors.
[   17.329178] [drm] kiq ring mec 2 pipe 1 q 0
[   17.373607] [drm] VCN decode and encode initialized successfully(under DPG Mode).
[   17.375920] [drm] JPEG decode initialized successfully.
[   17.375922] amdgpu 0000:00:04.0: amdgpu: SE 4, SH per SE 2, CU per SH 10, active_cu_number 80
[   17.377636] [drm] fb mappable at 0x800562000
[   17.377637] [drm] vram apper at 0x800000000
[   17.377638] [drm] size 8294400
[   17.377639] [drm] fb depth is 24
[   17.377639] [drm]    pitch is 7680
[   17.377765] fbcon: amdgpudrmfb (fb0) is primary device
[   17.440229] logitech-djreceiver 0003:046D:C534.0005: hiddev97,hidraw4: USB HID v1.11 Mouse [Logitech USB Receiver] on usb-0000:00:03.0-2.4/input1
[   17.511783] logitech-djreceiver 0003:046D:C534.0005: device of type eQUAD nano Lite (0x0a) connected on slot 1
[   17.512211] input: Logitech Wireless Keyboard PID:4023 Keyboard as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/0003:046D:4023.0006/input/input22
[   17.512532] hid-generic 0003:046D:4023.0006: input,hidraw5: USB HID v1.11 Keyboard [Logitech Wireless Keyboard PID:4023] on usb-0000:00:03.0-2.4/input1:1
[   17.513809] logitech-djreceiver 0003:046D:C534.0005: device of type eQUAD nano Lite (0x0a) connected on slot 2
[   17.514024] input: Logitech Wireless Mouse PID:4022 Mouse as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/0003:046D:4022.0007/input/input27
[   17.514338] hid-generic 0003:046D:4022.0007: input,hidraw6: USB HID v1.11 Mouse [Logitech Wireless Mouse PID:4022] on usb-0000:00:03.0-2.4/input1:2
[   19.479687] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[   23.799701] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[   28.119683] usb usb2-port2: Cannot enable. Maybe the USB cable is bad?
[   28.371260] [drm] REG_WAIT timeout 1us * 100000 tries - mpc2_assert_idle_mpcc line:480
[   28.371740] ------------[ cut here ]------------
[   28.371740] WARNING: CPU: 5 PID: 281 at drivers/gpu/drm/amd/amdgpu/../display/dc/dcn30/dcn30_hwseq.c:959 dcn30_set_hubp_blank+0x214/0x220 [amdgpu]
[   28.371893] Modules linked in: intel_rapl_common pcc_cpufreq(-) edac_mce_amd(-) rfkill 8021q garp mrp stp llc amd_energy crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel vfat crypto_simd cryptd fat hid_logitech_dj joydev mousedev amdgpu(+) snd_hda_codec_hdmi gpu_sched i2c_algo_bit snd_hda_intel drm_ttm_helper ppdev snd_intel_dspcfg ttm snd_intel_sdw_acpi snd_hda_codec drm_kms_helper snd_hda_core snd_hwdep iTCO_wdt snd_pcm syscopyarea intel_pmc_bxt sysfillrect iTCO_vendor_support sysimgblt fb_sys_fops psmouse cec snd_timer pcspkr i2c_i801 snd i2c_smbus lpc_ich e1000 intel_agp soundcore intel_gtt parport_pc parport qemu_fw_cfg usbhid mac_hid nfsd auth_rpcgss nfs_acl lockd grace drm sunrpc fuse sg agpgart nfs_ssc bpf_preload ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 serio_raw atkbd libps2 xhci_pci i8042 sr_mod crc32c_intel cdrom xhci_pci_renesas serio
[   28.371930] CPU: 5 PID: 281 Comm: systemd-udevd Not tainted 5.12.14-arch1-1-custom #1
[   28.371932] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009)/Standard PC (Q35 + ICH9, 2009), BIOS 0.0.0 02/06/2015
[   28.371933] RIP: 0010:dcn30_set_hubp_blank+0x214/0x220 [amdgpu]
[   28.372073] Code: 31 f6 48 8b 07 48 8b 40 50 e8 e8 eb 95 e9 48 8b 9b d0 02 00 00 48 85 db 75 df eb 8c 0f 0b e9 46 ff ff ff 0f 0b e9 be fe ff ff <0f> 0b e9 42 fe ff ff 0f 1f 44 00 00 0f 1f 44 00 00 41 57 41 56 45
[   28.372074] RSP: 0018:ffffbc5f009fb0f0 EFLAGS: 00010246
[   28.372075] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000003
[   28.372076] RDX: 0000000000000000 RSI: 0000000000003ab3 RDI: ffff93f44c280000
[   28.372077] RBP: ffff93f44e9401e8 R08: ffffbc5f009fb0dc R09: 0000000000000002
[   28.372077] R10: 3038343a656e696c R11: 343a656e696c2063 R12: ffff93f44e9401e8
[   28.372078] R13: ffff93f449bf0000 R14: 0000000000000000 R15: ffff93f44e9401e8
[   28.372080] FS:  00007ff804e96a40(0000) GS:ffff93f7afd40000(0000) knlGS:0000000000000000
[   28.372082] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[   28.372083] CR2: 00005586526ac278 CR3: 0000000102968000 CR4: 0000000000350ee0
[   28.372084] Call Trace:
[   28.372088]  dcn10_wait_for_mpcc_disconnect+0x116/0x190 [amdgpu]
[   28.372234]  dcn20_plane_atomic_disable+0x3e/0x150 [amdgpu]
[   28.372379]  dcn20_disable_plane+0x24/0x40 [amdgpu]
[   28.372518]  dcn10_init_pipes+0x307/0x3f0 [amdgpu]
[   28.372656]  dce110_enable_accelerated_mode+0x9c/0x260 [amdgpu]
[   28.372792]  dc_commit_state+0x983/0xa80 [amdgpu]
[   28.372925]  amdgpu_dm_atomic_commit_tail+0x5ee/0x2620 [amdgpu]
[   28.373070]  commit_tail+0x94/0x120 [drm_kms_helper]
[   28.373082]  drm_atomic_helper_commit+0x113/0x140 [drm_kms_helper]
[   28.373091]  drm_client_modeset_commit_atomic+0x1fc/0x240 [drm]
[   28.373110]  drm_client_modeset_commit_locked+0x56/0x150 [drm]
[   28.373126]  drm_client_modeset_commit+0x24/0x40 [drm]
[   28.373141]  drm_fb_helper_set_par+0xa5/0xd0 [drm_kms_helper]
[   28.373151]  fbcon_init+0x27c/0x500
[   28.373154]  visual_init+0xcc/0x120
[   28.373157]  do_bind_con_driver.isra.0+0x1c2/0x2c0
[   28.373159]  do_take_over_console+0x116/0x180
[   28.373161]  do_fbcon_takeover+0x58/0xb0
[   28.373162]  register_framebuffer+0x1f6/0x310
[   28.373164]  __drm_fb_helper_initial_config_and_unlock+0x337/0x4a0 [drm_kms_helper]
[   28.373174]  amdgpu_fbdev_init+0xb9/0xf0 [amdgpu]
[   28.373289]  amdgpu_device_init.cold+0x15e5/0x1a11 [amdgpu]
[   28.373437]  amdgpu_driver_load_kms+0x65/0x260 [amdgpu]
[   28.373550]  amdgpu_pci_probe+0x11f/0x1b0 [amdgpu]
[   28.373660]  local_pci_probe+0x42/0x80
[   28.373662]  ? __cond_resched+0x16/0x40
[   28.373665]  pci_device_probe+0xfa/0x1b0
[   28.373666]  really_probe+0xf2/0x440
[   28.373669]  driver_probe_device+0xe1/0x150
[   28.373670]  device_driver_attach+0xa1/0xb0
[   28.373672]  __driver_attach+0x8a/0x150
[   28.373674]  ? device_driver_attach+0xb0/0xb0
[   28.373675]  ? device_driver_attach+0xb0/0xb0
[   28.373676]  bus_for_each_dev+0x89/0xd0
[   28.373678]  bus_add_driver+0x12b/0x1e0
[   28.373679]  driver_register+0x8f/0xe0
[   28.373681]  ? 0xffffffffc106a000
[   28.373682]  do_one_initcall+0x57/0x1e0
[   28.373685]  do_init_module+0x5c/0x270
[   28.373688]  load_module+0x2545/0x2720
[   28.373691]  ? __do_sys_init_module+0x12e/0x1b0
[   28.373692]  __do_sys_init_module+0x12e/0x1b0
[   28.373694]  do_syscall_64+0x33/0x40
[   28.373697]  entry_SYSCALL_64_after_hwframe+0x44/0xae
[   28.373699] RIP: 0033:0x7ff8057cc32e
[   28.373700] Code: 48 8b 0d 45 0b 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 12 0b 0c 00 f7 d8 64 89 01 48
[   28.373701] RSP: 002b:00007ffd7b5f3278 EFLAGS: 00000246 ORIG_RAX: 00000000000000af
[   28.373702] RAX: ffffffffffffffda RBX: 0000556870e4ba40 RCX: 00007ff8057cc32e
[   28.373703] RDX: 00007ff805923a9d RSI: 0000000000d0fc81 RDI: 00007ff80324a010
[   28.373703] RBP: 00007ff80324a010 R08: 0000556870de40d0 R09: 0000000000d0fc90
[   28.373704] R10: 0000556d26619284 R11: 0000000000000246 R12: 00007ff805923a9d
[   28.373705] R13: 0000556870e4ba40 R14: 0000556870e68c90 R15: 0000556870e4ba40
[   28.373706] ---[ end trace 60eb76c2bccb62f2 ]---
[   28.540770] Decoding supported only on Scalable MCA processors.
[   28.789975] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[   28.793349] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[   28.794036] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2
[   28.794040] cfg80211: failed to load regulatory.db
[   28.917246] Console: switching to colour frame buffer device 240x67
[   31.319688] amdgpu 0000:00:04.0: [drm] fb0: amdgpudrmfb frame buffer device
[   31.360104] Decoding supported only on Scalable MCA processors.
[   31.383402] 8021q: adding VLAN 0 to HW filter on device enp0s1
[   31.399880] e1000: enp0s1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   31.400262] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s1: link becomes ready
[   31.521009] amdgpu 0000:00:04.0: amdgpu: ring gfx_0.0.0 uses VM inv eng 0 on hub 0
[   31.521013] amdgpu 0000:00:04.0: amdgpu: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[   31.521015] amdgpu 0000:00:04.0: amdgpu: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[   31.521017] amdgpu 0000:00:04.0: amdgpu: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[   31.521018] amdgpu 0000:00:04.0: amdgpu: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[   31.521020] amdgpu 0000:00:04.0: amdgpu: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[   31.521021] amdgpu 0000:00:04.0: amdgpu: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[   31.521022] amdgpu 0000:00:04.0: amdgpu: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[   31.521024] amdgpu 0000:00:04.0: amdgpu: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[   31.521025] amdgpu 0000:00:04.0: amdgpu: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[   31.521027] amdgpu 0000:00:04.0: amdgpu: ring sdma0 uses VM inv eng 12 on hub 0
[   31.521029] amdgpu 0000:00:04.0: amdgpu: ring sdma1 uses VM inv eng 13 on hub 0
[   31.521030] amdgpu 0000:00:04.0: amdgpu: ring sdma2 uses VM inv eng 14 on hub 0
[   31.521031] amdgpu 0000:00:04.0: amdgpu: ring sdma3 uses VM inv eng 15 on hub 0
[   31.521033] amdgpu 0000:00:04.0: amdgpu: ring vcn_dec_0 uses VM inv eng 0 on hub 1
[   31.521034] amdgpu 0000:00:04.0: amdgpu: ring vcn_enc_0.0 uses VM inv eng 1 on hub 1
[   31.521036] amdgpu 0000:00:04.0: amdgpu: ring vcn_enc_0.1 uses VM inv eng 4 on hub 1
[   31.521037] amdgpu 0000:00:04.0: amdgpu: ring vcn_dec_1 uses VM inv eng 5 on hub 1
[   31.521038] amdgpu 0000:00:04.0: amdgpu: ring vcn_enc_1.0 uses VM inv eng 6 on hub 1
[   31.521040] amdgpu 0000:00:04.0: amdgpu: ring vcn_enc_1.1 uses VM inv eng 7 on hub 1
[   31.521041] amdgpu 0000:00:04.0: amdgpu: ring jpeg_dec uses VM inv eng 8 on hub 1
[   32.121979] amdgpu 0000:00:04.0: amdgpu: Using BACO for runtime pm
[   32.140890] [drm] Initialized amdgpu 3.40.0 20150101 for 0000:00:04.0 on minor 0
[   34.039891] Decoding supported only on Scalable MCA processors.
[   34.046107] input: Logitech Wireless Keyboard PID:4023 as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/0003:046D:4023.0006/input/input31
[   34.046389] logitech-hidpp-device 0003:046D:4023.0006: input,hidraw5: USB HID v1.11 Keyboard [Logitech Wireless Keyboard PID:4023] on usb-0000:00:03.0-2.4/input1:1
[   34.146008] input: Logitech Wireless Mouse PID:4022 as /devices/pci0000:00/0000:00:03.0/usb1/1-2/1-2.4/1-2.4:1.1/0003:046D:C534.0005/0003:046D:4022.0007/input/input32
[   34.146274] logitech-hidpp-device 0003:046D:4022.0007: input,hidraw6: USB HID v1.11 Mouse [Logitech Wireless Mouse PID:4022] on usb-0000:00:03.0-2.4/input1:2
[   34.200827] Decoding supported only on Scalable MCA processors.
[   34.600278] Decoding supported only on Scalable MCA processors.
[   34.614724] RPC: Registered rdma transport module.
[   34.614728] RPC: Registered rdma backchannel transport module.
[   34.736955] NFSD: Using nfsdcld client tracking operations.
[   34.736958] NFSD: no clients to reclaim, skipping NFSv4 grace period (net f0000098)
[   37.183210] Decoding supported only on Scalable MCA processors.

So, some followup.

I settled on this QEMU config:

qemu-system-x86_64 \
-enable-kvm \
-m 16384 -mem-path /dev/hugepages \
-cpu host,kvm=off,hv-vendor-id=PC,hv-frequencies=on,hv-reenlightenment=on,hv-relaxed=on,hv-reset=on,hv-runtime=on,hv-spinlocks=4096,hv-time=on,hv-stimer=on,hv-stimer-direct=on,hv-synic=on,hv-vapic=on,hv-vpindex=on \
-smp cores=8,threads=1,sockets=1 \
-machine q35,vmport=off,kernel_irqchip=on \
-drive if=pflash,format=raw,readonly=on,file=ovmf_code.fd \
-drive if=pflash,format=raw,file=ovmf_vars-1024x768.fd \
-smbios type=2 \
-netdev bridge,id=net0,br=br0,"helper=/usr/lib/qemu/qemu-bridge-helper" \
-device e1000,netdev=net0,mac=00:25:4B:00:00:02 \
-device nvme,drive=nvme0,serial=deadbeaf1,max_ioqpairs=8 -drive file=vm2_sys.qcow2,if=none,id=nvme0 \
-device vfio-pci,host=01:00.0 \
-device vfio-pci,host=04:00.0 \
-device vfio-pci,host=04:00.1 \
-vga none

With some luck and care on a Linux VM the GPU does seem to work decently well. Xorg is accelerating, benchmarks show plausible performance, and the only thing that does not work is opencl (coming from proprietary drivers).

When it works, that is - every other run it gives a “watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [pulseaudio:754]” or a variant of it, and just fails to reach graphical mode. Often it would just take minutes to initialize amdgpu, but then works fine. No such issues on the host.

On Windows VM, all attempts to install AMD drivers still fail, producing a black screen. Best i can tell, the issue there is with the AMD drivers - i’ve seen convoluted online manuals on how to work around it, that don’t really work.

Even more interesting followup - if i remove all the extra options and leave only

-cpu host \
-smp cores=8,threads=1,sockets=1 \
-machine q35 \

Then Windows vm will boot and there would be a black screen instead of a hang. And if you use remote desktop you will find an error 43 for the GPU in device manager.

Progress.

Now, this problem is supposed to be solved by adding just the “hv-vendor-id=PC” line, which i tried next.

And with that the Windows VM now reliable crashes the host a few seconds after it goes into the black screen. Straight reboot.

Adding “kvm=off” gets us back to the old hang behaviour.

WTF?

None of that have much of an effect on the Linux vm, however, other than dropping the performance a little - OpenCL still does not work.

Further research. After tracing the opencl code on both host and linux vm i figured out that the critical difference was that on the host i had

[    7.145566] kfd kfd: Allocated 3969056 bytes on gart
[    7.146275] kfd kfd: added device 1002:73bf

While on the guest i had

[    3.617853] kfd kfd: skipped device 1002:73bf, PCI rejects atomics

So it comes down to Linux AMD drivers requiring “PCI atomics”, and so far i can not find a way get the PCIe Atomics to poke through the KVM.

The full list of possible solution appear to be summed in this thread - https://www.reddit.com/r/VFIO/comments/njgil2/making_pcie_atomics_work_with_vfio_passthrough/

None of that had any effect on OpenCL in Linux VM.

HOWEVER, changing the qemu config to reflect the correct topology:

-device pcie-root-port,chassis=1,id=root1,bus=pcie.0 \
-device vfio-pci,host=04:00.0,bus=root1,multifunction=on,addr=00.0 \
-device vfio-pci,host=04:00.1,bus=root1,addr=00.1 \

Did fix the Windows 10 VM issues. The latest drivers installed and everything works, including OpenCL.

So the only problem left is OpenCL in Linux VM.

2 Likes

Curious, did you ever find a solution for OpenCL in Linux VM (I have the same hardware and would eventually like to get something similar running)?

No, nothing i tried worked. I ended up using that card for Windows VMs.

I might have succeeded.

So, RX 6900 XT and many other AMD GPUs require PCIe atomics to work as something more than a dumb display output device.

And KVM does not pass this feature through, either because no one implemented it, or because it’s insecure.

A commonly cited solution to this, along the lines of
sudo setpci -v -d *:7300 80.b=40
Is wrong on execution level.

What you are trying to do is to set PCIE_CAP_ATOMIC_REQ_EN flag in DEVICE_CONTROL2_DEVICE_STATUS2_REG register of PCIE_CAP capability of PCI configuration space of the GPU, on the host.

PCI capabilities are a linked list, starting from a fixed field containing an offset to the first element, and following on. You need to find field id 0x10 in there, add 0x28 to it, and set bit 6 in it.

So using a fixed address of 0x80 makes you essentially set a random bit somewhere in configuration space, which is unlikely to do anything good.

Fortunately, setpci knows how to parse all this:
sudo setpci -v -s 63:00.0 CAP_EXP+28.b=40
Where 63:00.0 is the GPU address as shown by plain lspci call (which i find easier to use than vendor:device id used by the -d option).

You can observe the config state with sudo lspci -s 63:00.0 -xxx command to see if it worked or not.

Once you do that, the guest will now be theoretically capable of enabling atomics.
But, the way things are in the kernel it won’t actually succeed, since an attempt to do it will fail some condition checks. Apparently it does not recognize the passed through GPU as a PCIe device and treats it as a PCI device early on, and that screws things up.

The point is, you need to do some percussive maintenance to the kernel code to make it work.

Specifically, remove all the pesky sanity checks from pci_enable_atomic_ops_to_root function in drivers/pci/pci.c , i.e. with this patch:

diff --git a/drivers/pci/pci.c b/drivers/pci/pci.c
index a101faf3e88a..8594d85ca437 100644
--- a/drivers/pci/pci.c
+++ b/drivers/pci/pci.c
@@ -3719,24 +3719,13 @@ int pci_enable_atomic_ops_to_root(struct pci_dev *dev, u32 cap_mask)
 	struct pci_dev *bridge;
 	u32 cap, ctl2;
 
-	/*
-	 * Per PCIe r5.0, sec 9.3.5.10, the AtomicOp Requester Enable bit
-	 * in Device Control 2 is reserved in VFs and the PF value applies
-	 * to all associated VFs.
-	 */
+/*
 	if (dev->is_virtfn)
 		return -EINVAL;
 
 	if (!pci_is_pcie(dev))
 		return -EINVAL;
 
-	/*
-	 * Per PCIe r4.0, sec 6.15, endpoints and root ports may be
-	 * AtomicOp requesters.  For now, we only support endpoints as
-	 * requesters and root ports as completers.  No endpoints as
-	 * completers, and no peer-to-peer.
-	 */
-
 	switch (pci_pcie_type(dev)) {
 	case PCI_EXP_TYPE_ENDPOINT:
 	case PCI_EXP_TYPE_LEG_END:
@@ -3752,21 +3741,21 @@ int pci_enable_atomic_ops_to_root(struct pci_dev *dev, u32 cap_mask)
 		pcie_capability_read_dword(bridge, PCI_EXP_DEVCAP2, &cap);
 
 		switch (pci_pcie_type(bridge)) {
-		/* Ensure switch ports support AtomicOp routing */
+		//Ensure switch ports support AtomicOp routing
 		case PCI_EXP_TYPE_UPSTREAM:
 		case PCI_EXP_TYPE_DOWNSTREAM:
 			if (!(cap & PCI_EXP_DEVCAP2_ATOMIC_ROUTE))
 				return -EINVAL;
 			break;
 
-		/* Ensure root port supports all the sizes we care about */
+		//Ensure root port supports all the sizes we care about
 		case PCI_EXP_TYPE_ROOT_PORT:
 			if ((cap & cap_mask) != cap_mask)
 				return -EINVAL;
 			break;
 		}
 
-		/* Ensure upstream ports don't block AtomicOps on egress */
+		//Ensure upstream ports don't block AtomicOps on egress
 		if (pci_pcie_type(bridge) == PCI_EXP_TYPE_UPSTREAM) {
 			pcie_capability_read_dword(bridge, PCI_EXP_DEVCTL2,
 						   &ctl2);
@@ -3776,7 +3765,7 @@ int pci_enable_atomic_ops_to_root(struct pci_dev *dev, u32 cap_mask)
 
 		bus = bus->parent;
 	}
-
+*/
 	pcie_capability_set_word(dev, PCI_EXP_DEVCTL2,
 				 PCI_EXP_DEVCTL2_ATOMIC_REQ);
 	return 0;

The pci_enable_atomic_ops_to_root function is only used in infiniband, mellanox and amdgpu code, so it should be fairly safe to butcher like that, at least inside a VM.

So, the full sequence is:
-Patch the guest kernel
-Set the flag on the host
-Run the guest
-And it works for me now

References:

https://www.intel.com/content/www/us/en/programmable/pcie-register-map/current/index.html#qka1622676907547.html

https://wiki.osdev.org/PCI

2 Likes

Wow. Nice detective work! Thanks for the response!