Anyone familiar with Dell PowerEdge stuff w/idrac?

Working on a Proxmox update. Since they advise caution, I figure I’ll just throw a brand new install onto a new SSD I just put into this R720. But I’m not a sysadmin so I have some questions.

Am I going to have any trouble if I just power down, pull the drive currently in use, do the install to the new drive, and then push the old one back in to do VM migration? …Hopefully then I can use this idrac virtual console thing to tell the BIOS to boot to the new disk.

After adding the second SSD just now I realize I’d forgotten how NOT plug-and-play these are. (I had to create a ‘virtual disk’ in RAID-0 mode even though it’s just one disk. It’s just weird how long it takes to “apply” that after a reboot. What the heck was it doing running this “pending operation” in idrac for so long?)

Just a little paranoid about the RAID controller on this thing being hyper sensitive to a drive being pulled and put back in.

It’s trivially easy. Remove the drive, clear the RAID configuration. Insert new drive, import foreign RAID config.

Hopefully it’s obvious you should NOT clear the RAID config while a drive with valuable data is inserted.

I’m sure it is once you’ve done it one time, but I’ve not done this at all yet. I already have the new drive inserted and working as a second ‘virtual disk’ (RAID-0 also).

So then I guess:

  • Remove old disk
  • Delete old “virtual disk” (via Virtual Disk Actions->Delete) ? (I thought it would just vanish on its own…)
  • Install Proxmox to already inserted new disk
  • Re-add old disk and “import”

For the last step I don’t see any option for “Import foreign RAID config” anywhere in the Virtual Disks or Physical Disks menus, is that something it’ll prompt for when it detects that the drive came back? Not great with RAID stuff so none of this is immeidately obvious to me.

I called it “easy” intended as encouragement, not criticism.

Yes, the “Foreign” menu / options are hidden until needed:


Obviously you’ll want to “Import” it and NOT clear it.

When all drives are removed, I prefer to “Clear” the controller config (see above screenshot), rather than delete (each individual) virtual disk.

I’ll poke around to see if I can find that utility, but this is what I’m looking at in a browser via idrac:

“disk1” is the original one.

Maybe I can do the same thing from this interface? The utility you’re running looks like something accessed directly from the console.

Maybe one of these options? I only vaguely remember checking out all these when I first got this box a while ago.

You’re close. You should get prompted to hit CTRL-R shortly after:

You should be able to do the same from the iDRAC web interface.

1 Like

Ahhh, yes I think I remember that. Once I got the backup files somewhere safe we’ll see how this goes.

So the referenced config, is the bios screen of the Perc Raid card, rather than the BMC or motherboard bios.

Is it worth OP pulling all drives, then rebooting, using CTRL+R to access the raid card, and poking around in there empty, seeing what menus with little damage to be done?

I thought about doing something like that to see how it’ll react, but I think I’d like the upgrade to be done before the end of the weekend so I decided to “roll the dice” (there’s nothing I can’t rebuild here with some time anyway).

It was clear enough which drive I was installing to. So the old drive is still in the system, Proxmox installed to the NEW drive, and running fine so far.

Just got a bunch of configuration preferences stuff to redo, and a few VMs to try restoring now.

I guessed (wrongly) it’d be smart enough to give me a second Grub option to choose either instance… but it turns out that’s NOT what it does. It also (annoyingly) did this “OLD” renaming junk with the old drive - I think I’m okay with that since some Proxmox people say you can just reverse it.

Hopefully I can just mount that old stuff and grab the .zst backups directly so I don’t need to wait for rsync, but if not I have things backed up on another device.

I need to go forward anyway, restoring the old one just puts me back on a totally out of support version.

Next time, a different strategy would be to setup the second SSD as a mirror in the controller bios, wait for sync, then pull it (with the server shut down) and boot with only one and upgrade. If things go catastrophically wrong you pull the bored SSD, reinsert the mirror and rinse and repeat…
Just make sure you have the right menu choices in the controller bios…

1 Like

Maybe time for a new Proxmox specific thread. The restores seemed to go okay, except I can’t get any VMs to start at all (not even a new one so I don’t THINK it’s an issue with the backups).

TASK ERROR: KVM virtualisation configured, but not available. Either disable in VM configuration or enable in BIOS.

Well that’s nonsense, of course it’s still enabled (I went and checked just in case lol).

If I try disabling KVM in options (which I don’t want to do anyway):

# qm start 109
KVM virtualisation configured, but not available. Either disable in VM configuration or enable in BIOS.
# qm start 109
Error: Unknown device type.
can't create interface fwln109i0 - command '/sbin/ip link add name fwln109i0 mtu 1500 type veth peer name fwpr109p0 mtu 1500' failed: exit code 2

kvm: -netdev type=tap,id=net0,ifname=tap109i0,script=/var/lib/qemu-server/pve-bridge,downscript=/var/lib/qemu-server/pve-bridgedown: network script /var/lib/qemu-server/pve-bridge failed with status 512
start failed: QEMU exited with code 1

Remove and re-add of the ‘network device’ did nothing to fix that.

I do note a bunch of nasty errors at boot though. Some don’t seem too crucial but one or two sound worrying and I have yet to discover what the heck they mean.

# dmesg
[    0.000000] Linux version 5.4.203-1-pve (build@proxmox) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP PVE 5.4.203-1 (Fri, 26 Aug 2022 14:43:35 +0200) ()
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.203-1-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt video=efifb:off video=vesafb:off
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000]   zhaoxin   Shanghai  
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007d2effff] usable
[    0.000000] BIOS-e820: [mem 0x000000007d2f0000-0x000000007d31bfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000007d31c000-0x000000007d35afff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000007d35b000-0x000000007fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000307fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Dell Inc. PowerEdge R720/061P35, BIOS 2.6.1 02/12/2018
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2899.892 MHz processor
[    0.002295] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.002297] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.002300] last_pfn = 0x3080000 max_arch_pfn = 0x400000000
[    0.002303] MTRR default type: uncachable
[    0.002303] MTRR fixed ranges enabled:
[    0.002304]   00000-9FFFF write-back
[    0.002305]   A0000-BFFFF uncachable
[    0.002305]   C0000-C7FFF write-protect
[    0.002306]   C8000-CFFFF write-back
[    0.002306]   D0000-EBFFF uncachable
[    0.002307]   EC000-FFFFF write-protect
[    0.002308] MTRR variable ranges enabled:
[    0.002309]   0 base 000000000000 mask 3FFF80000000 write-back
[    0.002310]   1 base 000100000000 mask 3FFF00000000 write-back
[    0.002310]   2 base 000200000000 mask 3FFE00000000 write-back
[    0.002311]   3 base 000400000000 mask 3FFC00000000 write-back
[    0.002311]   4 base 000800000000 mask 3FF800000000 write-back
[    0.002312]   5 base 001000000000 mask 3FF000000000 write-back
[    0.002313]   6 base 002000000000 mask 3FF000000000 write-back
[    0.002313]   7 base 003000000000 mask 3FFF80000000 write-back
[    0.002314]   8 disabled
[    0.002314]   9 disabled
[    0.002628] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.002779] e820: update [mem 0x80000000-0xffffffff] usable ==> reserved
[    0.002783] last_pfn = 0x7d2f0 max_arch_pfn = 0x400000000
[    0.010801] found SMP MP-table at [mem 0x000fe710-0x000fe71f]
[    0.023324] check: Scanning 1 areas for low memory corruption
[    0.023328] Using GB pages for direct mapping
[    0.023474] RAMDISK: [mem 0x325cd000-0x352ddfff]
[    0.023475] ACPI: Early table checksum verification disabled
[    0.023478] ACPI: RSDP 0x00000000000F0C40 000024 (v02 DELL  )
[    0.023480] ACPI: XSDT 0x00000000000F0D88 0000A4 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023484] ACPI: FACP 0x000000007D33534C 0000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023488] ACPI: DSDT 0x000000007D31C000 008029 (v01 DELL   PE_SC3   00000001 INTL 20110211)
[    0.023491] ACPI: FACS 0x000000007D337000 000040
[    0.023493] ACPI: FACS 0x000000007D337000 000040
[    0.023495] ACPI: APIC 0x000000007D334478 0001EA (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023497] ACPI: SPCR 0x000000007D334664 000050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023499] ACPI: HPET 0x000000007D3346B8 000038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023501] ACPI: DMAR 0x000000007D3346F4 000160 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023504] ACPI: MCFG 0x000000007D334A10 00003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023506] ACPI: WD__ 0x000000007D334A50 000134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023508] ACPI: SLIC 0x000000007D334B88 000024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023510] ACPI: ERST 0x000000007D3241EC 000270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023513] ACPI: HEST 0x000000007D32445C 00055C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023515] ACPI: BERT 0x000000007D32402C 000030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023517] ACPI: EINJ 0x000000007D32405C 000190 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023519] ACPI: TCPA 0x000000007D3352E4 000064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023522] ACPI: PC__ 0x000000007D335274 00006E (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023524] ACPI: SRAT 0x000000007D334DB0 0004C0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.023526] ACPI: SSDT 0x000000007D338000 00A2B4 (v01 INTEL  PPM RCM  80000001 INTL 20061109)
[    0.023529] ACPI: Reserving FACP table memory at [mem 0x7d33534c-0x7d33543f]
[    0.023529] ACPI: Reserving DSDT table memory at [mem 0x7d31c000-0x7d324028]
[    0.023530] ACPI: Reserving FACS table memory at [mem 0x7d337000-0x7d33703f]
[    0.023530] ACPI: Reserving FACS table memory at [mem 0x7d337000-0x7d33703f]
[    0.023531] ACPI: Reserving APIC table memory at [mem 0x7d334478-0x7d334661]
[    0.023532] ACPI: Reserving SPCR table memory at [mem 0x7d334664-0x7d3346b3]
[    0.023532] ACPI: Reserving HPET table memory at [mem 0x7d3346b8-0x7d3346ef]
[    0.023533] ACPI: Reserving DMAR table memory at [mem 0x7d3346f4-0x7d334853]
[    0.023533] ACPI: Reserving MCFG table memory at [mem 0x7d334a10-0x7d334a4b]
[    0.023534] ACPI: Reserving WD__ table memory at [mem 0x7d334a50-0x7d334b83]
[    0.023534] ACPI: Reserving SLIC table memory at [mem 0x7d334b88-0x7d334bab]
[    0.023535] ACPI: Reserving ERST table memory at [mem 0x7d3241ec-0x7d32445b]
[    0.023536] ACPI: Reserving HEST table memory at [mem 0x7d32445c-0x7d3249b7]
[    0.023536] ACPI: Reserving BERT table memory at [mem 0x7d32402c-0x7d32405b]
[    0.023537] ACPI: Reserving EINJ table memory at [mem 0x7d32405c-0x7d3241eb]
[    0.023538] ACPI: Reserving TCPA table memory at [mem 0x7d3352e4-0x7d335347]
[    0.023538] ACPI: Reserving PC__ table memory at [mem 0x7d335274-0x7d3352e1]
[    0.023539] ACPI: Reserving SRAT table memory at [mem 0x7d334db0-0x7d33526f]
[    0.023539] ACPI: Reserving SSDT table memory at [mem 0x7d338000-0x7d3422b3]
[    0.023547] ACPI: Local APIC address 0xfee00000
[    0.023568] SRAT: PXM 1 -> APIC 0x00 -> Node 0
[    0.023569] SRAT: PXM 2 -> APIC 0x20 -> Node 1
[    0.023570] SRAT: PXM 1 -> APIC 0x02 -> Node 0
[    0.023570] SRAT: PXM 2 -> APIC 0x22 -> Node 1
[    0.023571] SRAT: PXM 1 -> APIC 0x04 -> Node 0
[    0.023571] SRAT: PXM 2 -> APIC 0x24 -> Node 1
[    0.023572] SRAT: PXM 1 -> APIC 0x06 -> Node 0
[    0.023572] SRAT: PXM 2 -> APIC 0x26 -> Node 1
[    0.023573] SRAT: PXM 1 -> APIC 0x08 -> Node 0
[    0.023573] SRAT: PXM 2 -> APIC 0x28 -> Node 1
[    0.023574] SRAT: PXM 1 -> APIC 0x0a -> Node 0
[    0.023574] SRAT: PXM 2 -> APIC 0x2a -> Node 1
[    0.023575] SRAT: PXM 1 -> APIC 0x0c -> Node 0
[    0.023575] SRAT: PXM 2 -> APIC 0x2c -> Node 1
[    0.023576] SRAT: PXM 1 -> APIC 0x0e -> Node 0
[    0.023576] SRAT: PXM 2 -> APIC 0x2e -> Node 1
[    0.023576] SRAT: PXM 1 -> APIC 0x01 -> Node 0
[    0.023577] SRAT: PXM 2 -> APIC 0x21 -> Node 1
[    0.023577] SRAT: PXM 1 -> APIC 0x03 -> Node 0
[    0.023578] SRAT: PXM 2 -> APIC 0x23 -> Node 1
[    0.023578] SRAT: PXM 1 -> APIC 0x05 -> Node 0
[    0.023579] SRAT: PXM 2 -> APIC 0x25 -> Node 1
[    0.023579] SRAT: PXM 1 -> APIC 0x07 -> Node 0
[    0.023580] SRAT: PXM 2 -> APIC 0x27 -> Node 1
[    0.023580] SRAT: PXM 1 -> APIC 0x09 -> Node 0
[    0.023581] SRAT: PXM 2 -> APIC 0x29 -> Node 1
[    0.023581] SRAT: PXM 1 -> APIC 0x0b -> Node 0
[    0.023582] SRAT: PXM 2 -> APIC 0x2b -> Node 1
[    0.023582] SRAT: PXM 1 -> APIC 0x0d -> Node 0
[    0.023583] SRAT: PXM 2 -> APIC 0x2d -> Node 1
[    0.023583] SRAT: PXM 1 -> APIC 0x0f -> Node 0
[    0.023584] SRAT: PXM 2 -> APIC 0x2f -> Node 1
[    0.023587] ACPI: SRAT: Node 0 PXM 1 [mem 0x00000000-0x187fffffff]
[    0.023588] ACPI: SRAT: Node 1 PXM 2 [mem 0x1880000000-0x307fffffff]
[    0.023597] NODE_DATA(0) allocated [mem 0x187ffd5000-0x187fffffff]
[    0.023622] NODE_DATA(1) allocated [mem 0x307ffd5000-0x307fffffff]
[    0.023937] Zone ranges:
[    0.023937]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.023938]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.023939]   Normal   [mem 0x0000000100000000-0x000000307fffffff]
[    0.023940]   Device   empty
[    0.023940] Movable zone start for each node
[    0.023943] Early memory node ranges
[    0.023944]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.023944]   node   0: [mem 0x0000000000100000-0x000000007d2effff]
[    0.023945]   node   0: [mem 0x0000000100000000-0x000000187fffffff]
[    0.023951]   node   1: [mem 0x0000001880000000-0x000000307fffffff]
[    0.024108] Zeroed struct page in unavailable ranges: 11635 pages
[    0.024109] Initmem setup node 0 [mem 0x0000000000001000-0x000000187fffffff]
[    0.024110] On node 0 totalpages: 25154189
[    0.024111]   DMA zone: 64 pages used for memmap
[    0.024111]   DMA zone: 21 pages reserved
[    0.024112]   DMA zone: 3997 pages, LIFO batch:0
[    0.024193]   DMA32 zone: 7948 pages used for memmap
[    0.024194]   DMA32 zone: 508656 pages, LIFO batch:63
[    0.032973]   Normal zone: 385024 pages used for memmap
[    0.032975]   Normal zone: 24641536 pages, LIFO batch:63
[    0.344692] Initmem setup node 1 [mem 0x0000001880000000-0x000000307fffffff]
[    0.344695] On node 1 totalpages: 25165824
[    0.344696]   Normal zone: 393216 pages used for memmap
[    0.344697]   Normal zone: 25165824 pages, LIFO batch:63
[    0.728617] ACPI: PM-Timer IO Port: 0x808
[    0.728621] ACPI: Local APIC address 0xfee00000
[    0.728632] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.728644] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.728647] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 32-55
[    0.728651] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 64-87
[    0.728653] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.728655] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.728656] ACPI: IRQ0 used by override.
[    0.728657] ACPI: IRQ9 used by override.
[    0.728659] Using ACPI (MADT) for SMP configuration information
[    0.728660] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.728664] ACPI: SPCR: SPCR table version 1
[    0.728664] ACPI: SPCR: Unexpected SPCR Access Width.  Defaulting to byte size
[    0.728667] ACPI: SPCR: console: uart,mmio,0x0
[    0.728669] TSC deadline timer available
[    0.728670] smpboot: Allowing 48 CPUs, 16 hotplug CPUs
[    0.728684] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.728685] PM: Registered nosave memory: [mem 0x0009e000-0x000fffff]
[    0.728686] PM: Registered nosave memory: [mem 0x7d2f0000-0x7d31bfff]
[    0.728687] PM: Registered nosave memory: [mem 0x7d31c000-0x7d35afff]
[    0.728687] PM: Registered nosave memory: [mem 0x7d35b000-0x7fffffff]
[    0.728688] PM: Registered nosave memory: [mem 0x80000000-0xdfffffff]
[    0.728688] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.728689] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[    0.728689] PM: Registered nosave memory: [mem 0xfe000000-0xffffffff]
[    0.728691] [mem 0x80000000-0xdfffffff] available for PCI devices
[    0.728692] Booting paravirtualized kernel on bare hardware
[    0.728695] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.728701] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:48 nr_cpu_ids:48 nr_node_ids:2
[    0.731138] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144
[    0.731144] pcpu-alloc: s208896 r8192 d28672 u262144 alloc=1*2097152
[    0.731145] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 24 26 28 30 
[    0.731149] pcpu-alloc: [0] 32 34 36 38 40 42 44 46 [1] 01 03 05 07 09 11 13 15 
[    0.731152] pcpu-alloc: [1] 17 19 21 23 25 27 29 31 [1] 33 35 37 39 41 43 45 47 
[    0.731184] Built 2 zonelists, mobility grouping on.  Total pages: 49533740
[    0.731184] Policy zone: Normal
[    0.731186] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.203-1-pve root=/dev/mapper/pve-root ro quiet intel_iommu=on iommu=pt video=efifb:off video=vesafb:off
[    0.731250] DMAR: IOMMU enabled
[    0.731296] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.731297] printk: log_buf_len total cpu_extra contributions: 192512 bytes
[    0.731297] printk: log_buf_len min size: 262144 bytes
[    0.731415] printk: log_buf_len: 524288 bytes
[    0.731416] printk: early log buf free: 248496(94%)
[    0.731977] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.741413] Calgary: detecting Calgary via BIOS EBDA area
[    0.741415] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    1.294500] Memory: 197972708K/201280052K available (14339K kernel code, 2361K rwdata, 9184K rodata, 2728K init, 5012K bss, 3307344K reserved, 0K cma-reserved)
[    1.295003] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=48, Nodes=2
[    1.295031] Kernel/User page tables isolation: enabled
[    1.295063] ftrace: allocating 44458 entries in 174 pages
[    1.309907] rcu: Hierarchical RCU implementation.
[    1.309908] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=48.
[    1.309909] 	Tasks RCU enabled.
[    1.309909] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    1.309910] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=48
[    1.312469] NR_IRQS: 524544, nr_irqs: 1896, preallocated irqs: 16
[    1.321336] Console: colour VGA+ 80x25
[    1.321456] printk: console [tty0] enabled
[    1.321520] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.321522] ACPI: Core revision 20190816
[    1.321660] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    1.321669] APIC: Switch to symmetric I/O mode setup
[    1.321671] DMAR: Host address width 46
[    1.321672] DMAR: DRHD base: 0x000000d6000000 flags: 0x0
[    1.321677] DMAR: dmar0: reg_base_addr d6000000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.321677] DMAR: DRHD base: 0x000000df900000 flags: 0x1
[    1.321681] DMAR: dmar1: reg_base_addr df900000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.321682] DMAR: RMRR base: 0x0000007f458000 end: 0x0000007f46ffff
[    1.321682] DMAR: RMRR base: 0x0000007f450000 end: 0x0000007f450fff
[    1.321683] DMAR: RMRR base: 0x0000007f452000 end: 0x0000007f452fff
[    1.321684] DMAR: ATSR flags: 0x0
[    1.321686] DMAR-IR: IOAPIC id 2 under DRHD base  0xd6000000 IOMMU 0
[    1.321687] DMAR-IR: IOAPIC id 0 under DRHD base  0xdf900000 IOMMU 1
[    1.321687] DMAR-IR: IOAPIC id 1 under DRHD base  0xdf900000 IOMMU 1
[    1.321688] DMAR-IR: HPET id 0 under DRHD base 0xdf900000
[    1.321689] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    1.321689] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    1.322170] DMAR-IR: Enabled IRQ remapping in xapic mode
[    1.322171] x2apic: IRQ remapping doesn't support X2APIC mode
[    1.322174] Switched APIC routing to physical flat.
[    1.322784] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    1.341687] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x29ccdd60921, max_idle_ns: 440795328608 ns
[    1.341690] Calibrating delay loop (skipped), value calculated using timer frequency.. 5799.78 BogoMIPS (lpj=11599568)
[    1.341691] pid_max: default: 49152 minimum: 384
[    1.341814] LSM: Security Framework initializing
[    1.341832] Yama: becoming mindful.
[    1.342059] AppArmor: AppArmor initialized
[    1.361866] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc)
[    1.373176] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc)
[    1.373552] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    1.373887] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    1.373930] *** VALIDATE tmpfs ***
[    1.374165] *** VALIDATE proc ***
[    1.374284] *** VALIDATE cgroup1 ***
[    1.374285] *** VALIDATE cgroup2 ***
[    1.374373] mce: CPU0: Thermal monitoring enabled (TM1)
[    1.374405] process: using mwait in idle threads
[    1.374408] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    1.374408] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    1.374412] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    1.374414] Spectre V2 : Mitigation: Retpolines
[    1.374414] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    1.374415] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    1.374416] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    1.374417] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl
[    1.374418] Speculative Store Bypass: Vulnerable
[    1.374421] MDS: Vulnerable: Clear CPU buffers attempted, no microcode
[    1.374576] Freeing SMP alternatives memory: 40K
[    1.377608] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2690 0 @ 2.90GHz (family: 0x6, model: 0x2d, stepping: 0x7)
[    1.377688] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    1.377688] ... version:                3
[    1.377688] ... bit width:              48
[    1.377688] ... generic registers:      4
[    1.377688] ... value mask:             0000ffffffffffff
[    1.377688] ... max period:             00007fffffffffff
[    1.377688] ... fixed-purpose events:   3
[    1.377688] ... event mask:             000000070000000f
[    1.377688] rcu: Hierarchical SRCU implementation.
[    1.377688] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    1.378082] smp: Bringing up secondary CPUs ...
[    1.378244] x86: Booting SMP configuration:
[    1.378245] .... node  #1, CPUs:        #1
[    0.012995] smpboot: CPU 1 Converting physical 0 to logical die 1
[    1.462015] .... node  #0, CPUs:    #2
[    1.465923] .... node  #1, CPUs:    #3
[    1.469935] .... node  #0, CPUs:    #4
[    1.472681] .... node  #1, CPUs:    #5
[    1.476851] .... node  #0, CPUs:    #6
[    1.480151] .... node  #1, CPUs:    #7
[    1.484083] .... node  #0, CPUs:    #8
[    1.485916] .... node  #1, CPUs:    #9
[    1.489942] .... node  #0, CPUs:   #10
[    1.492670] .... node  #1, CPUs:   #11
[    1.496839] .... node  #0, CPUs:   #12
[    1.500123] .... node  #1, CPUs:   #13
[    1.504040] .... node  #0, CPUs:   #14
[    1.505916] .... node  #1, CPUs:   #15
[    1.509945] .... node  #0, CPUs:   #16
[    1.512808] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[    1.512808] .... node  #1, CPUs:   #17
[    1.517753] .... node  #0, CPUs:   #18
[    1.520535] .... node  #1, CPUs:   #19
[    1.524458] .... node  #0, CPUs:   #20
[    1.527747] .... node  #1, CPUs:   #21
[    1.531766] .... node  #0, CPUs:   #22
[    1.533931] .... node  #1, CPUs:   #23
[    1.537947] .... node  #0, CPUs:   #24
[    1.540670] .... node  #1, CPUs:   #25
[    1.544933] .... node  #0, CPUs:   #26
[    1.548219] .... node  #1, CPUs:   #27
[    1.552159] .... node  #0, CPUs:   #28
[    1.553913] .... node  #1, CPUs:   #29
[    1.557901] .... node  #0, CPUs:   #30
[    1.560655] .... node  #1, CPUs:   #31
[    1.564805] smp: Brought up 2 nodes, 32 CPUs
[    1.564805] smpboot: Max logical packages: 3
[    1.564805] smpboot: Total of 32 processors activated (185620.56 BogoMIPS)
[    1.574668] devtmpfs: initialized
[    1.574668] x86/mm: Memory block size: 2048MB
[    1.575014] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.575014] futex hash table entries: 16384 (order: 8, 1048576 bytes, vmalloc)
[    1.575014] pinctrl core: initialized pinctrl subsystem
[    1.575014] PM: RTC time: 08:37:59, date: 2023-05-21
[    1.575014] NET: Registered protocol family 16
[    1.575014] audit: initializing netlink subsys (disabled)
[    1.575014] audit: type=2000 audit(1684658279.252:1): state=initialized audit_enabled=0 res=1
[    1.575014] EISA bus registered
[    1.575014] cpuidle: using governor ladder
[    1.575014] cpuidle: using governor menu
[    1.575014] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    1.575014] ACPI: bus type PCI registered
[    1.575014] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.575014] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    1.575014] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    1.575014] PCI: Using configuration type 1 for base access
[    1.575014] PCI: Dell System detected, enabling pci=bfsort.
[    1.575014] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    1.575014] mtrr: your CPUs had inconsistent variable MTRR settings
[    1.575014] mtrr: probably your BIOS does not setup all CPUs.
[    1.575014] mtrr: corrected configuration.
[    1.577975] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    1.577975] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.581894] ACPI: Added _OSI(Module Device)
[    1.581895] ACPI: Added _OSI(Processor Device)
[    1.581896] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.581896] ACPI: Added _OSI(Processor Aggregator Device)
[    1.581897] ACPI: Added _OSI(Linux-Dell-Video)
[    1.581898] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    1.581899] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    1.583529] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    1.583933] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    1.589854] ACPI: Interpreter enabled
[    1.589866] ACPI: (supports S0 S4 S5)
[    1.589867] ACPI: Using IOAPIC for interrupt routing
[    1.590136] HEST: Table parsing has been initialized.
[    1.590138] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.590341] ACPI: Enabled 4 GPEs in block 00 to 3F
[    1.599516] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    1.599530] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.599658] acpi PNP0A08:00: PCIe AER handled by firmware
[    1.599912] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    1.599913] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.600930] PCI host bridge to bus 0000:00
[    1.600932] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    1.600941] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    1.600942] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    1.600944] pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff window]
[    1.600945] pci_bus 0000:00: root bus resource [io  0xe000-0xffff window]
[    1.600946] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.600947] pci_bus 0000:00: root bus resource [mem 0xd8000000-0xdfffffff window]
[    1.600948] pci_bus 0000:00: root bus resource [mem 0x3c000000000-0x3ffffffffff window]
[    1.600949] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[    1.600950] pci_bus 0000:00: root bus resource [bus 00-3d]
[    1.600991] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000
[    1.601066] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    1.601151] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400
[    1.601235] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    1.601356] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400
[    1.601440] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    1.601540] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400
[    1.601625] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    1.601769] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400
[    1.601854] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    1.601951] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400
[    1.601991] pci 0000:00:03.0: enabling Extended Tags
[    1.602039] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    1.602179] pci 0000:00:03.2: [8086:3c0a] type 01 class 0x060400
[    1.602264] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[    1.602403] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000
[    1.602536] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000
[    1.602653] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    1.602755] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    1.602840] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    1.602860] pci 0000:00:16.0: reg 0x10: [mem 0xdf8fc000-0xdf8fc00f 64bit]
[    1.602917] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    1.602987] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[    1.603006] pci 0000:00:16.1: reg 0x10: [mem 0xdf8fd000-0xdf8fd00f 64bit]
[    1.603063] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    1.603153] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    1.603172] pci 0000:00:1a.0: reg 0x10: [mem 0xdf8fe000-0xdf8fe3ff]
[    1.603250] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    1.603317] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[    1.603401] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    1.603420] pci 0000:00:1c.0: Enabling MPC IRBNCE
[    1.603422] pci 0000:00:1c.0: Intel PCH root port ACS workaround enabled
[    1.603526] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[    1.603611] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    1.603629] pci 0000:00:1c.7: Enabling MPC IRBNCE
[    1.603630] pci 0000:00:1c.7: Intel PCH root port ACS workaround enabled
[    1.603708] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    1.603727] pci 0000:00:1d.0: reg 0x10: [mem 0xdf8ff000-0xdf8ff3ff]
[    1.603805] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    1.603876] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    1.603978] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    1.604144] pci 0000:00:1f.2: [8086:1d00] type 00 class 0x01018f
[    1.604159] pci 0000:00:1f.2: reg 0x10: [io  0xecd0-0xecd7]
[    1.604165] pci 0000:00:1f.2: reg 0x14: [io  0xecf0-0xecf3]
[    1.604171] pci 0000:00:1f.2: reg 0x18: [io  0xecd8-0xecdf]
[    1.604178] pci 0000:00:1f.2: reg 0x1c: [io  0xecf4-0xecf7]
[    1.604184] pci 0000:00:1f.2: reg 0x20: [io  0xec90-0xec9f]
[    1.604190] pci 0000:00:1f.2: reg 0x24: [io  0xeca0-0xecaf]
[    1.604276] pci 0000:00:1f.5: [8086:1d08] type 00 class 0x010185
[    1.604290] pci 0000:00:1f.5: reg 0x10: [io  0xece0-0xece7]
[    1.604296] pci 0000:00:1f.5: reg 0x14: [io  0xecf8-0xecfb]
[    1.604302] pci 0000:00:1f.5: reg 0x18: [io  0xece8-0xecef]
[    1.604308] pci 0000:00:1f.5: reg 0x1c: [io  0xecfc-0xecff]
[    1.604315] pci 0000:00:1f.5: reg 0x20: [io  0xecb0-0xecbf]
[    1.604321] pci 0000:00:1f.5: reg 0x24: [io  0xecc0-0xeccf]
[    1.604491] pci 0000:02:00.0: [14e4:165f] type 00 class 0x020000
[    1.604511] pci 0000:02:00.0: reg 0x10: [mem 0xd90a0000-0xd90affff 64bit pref]
[    1.604521] pci 0000:02:00.0: reg 0x18: [mem 0xd90b0000-0xd90bffff 64bit pref]
[    1.604531] pci 0000:02:00.0: reg 0x20: [mem 0xd90c0000-0xd90cffff 64bit pref]
[    1.604538] pci 0000:02:00.0: reg 0x30: [mem 0xdc000000-0xdc03ffff pref]
[    1.604595] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    1.604620] pci 0000:02:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x1 link at 0000:00:01.0 (capable of 8.000 Gb/s with 5.0 GT/s PCIe x2 link)
[    1.604714] pci 0000:02:00.1: [14e4:165f] type 00 class 0x020000
[    1.604734] pci 0000:02:00.1: reg 0x10: [mem 0xd90d0000-0xd90dffff 64bit pref]
[    1.604744] pci 0000:02:00.1: reg 0x18: [mem 0xd90e0000-0xd90effff 64bit pref]
[    1.604754] pci 0000:02:00.1: reg 0x20: [mem 0xd90f0000-0xd90fffff 64bit pref]
[    1.604761] pci 0000:02:00.1: reg 0x30: [mem 0xdc000000-0xdc03ffff pref]
[    1.604818] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    1.604950] pci 0000:00:01.0: PCI bridge to [bus 02]
[    1.604954] pci 0000:00:01.0:   bridge window [mem 0xdc000000-0xdc7fffff]
[    1.604958] pci 0000:00:01.0:   bridge window [mem 0xd9000000-0xd90fffff 64bit pref]
[    1.605015] pci 0000:01:00.0: [14e4:165f] type 00 class 0x020000
[    1.605034] pci 0000:01:00.0: reg 0x10: [mem 0xd91a0000-0xd91affff 64bit pref]
[    1.605044] pci 0000:01:00.0: reg 0x18: [mem 0xd91b0000-0xd91bffff 64bit pref]
[    1.605054] pci 0000:01:00.0: reg 0x20: [mem 0xd91c0000-0xd91cffff 64bit pref]
[    1.605061] pci 0000:01:00.0: reg 0x30: [mem 0xdc800000-0xdc83ffff pref]
[    1.605117] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    1.605141] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x1 link at 0000:00:01.1 (capable of 8.000 Gb/s with 5.0 GT/s PCIe x2 link)
[    1.605226] pci 0000:01:00.1: [14e4:165f] type 00 class 0x020000
[    1.605246] pci 0000:01:00.1: reg 0x10: [mem 0xd91d0000-0xd91dffff 64bit pref]
[    1.605256] pci 0000:01:00.1: reg 0x18: [mem 0xd91e0000-0xd91effff 64bit pref]
[    1.605266] pci 0000:01:00.1: reg 0x20: [mem 0xd91f0000-0xd91fffff 64bit pref]
[    1.605273] pci 0000:01:00.1: reg 0x30: [mem 0xdc800000-0xdc83ffff pref]
[    1.605330] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    1.605456] pci 0000:00:01.1: PCI bridge to [bus 01]
[    1.605460] pci 0000:00:01.1:   bridge window [mem 0xdc800000-0xdcffffff]
[    1.605464] pci 0000:00:01.1:   bridge window [mem 0xd9100000-0xd91fffff 64bit pref]
[    1.605499] pci 0000:00:02.0: PCI bridge to [bus 04]
[    1.605540] pci 0000:03:00.0: [1000:005b] type 00 class 0x010400
[    1.605552] pci 0000:03:00.0: reg 0x10: [io  0xfc00-0xfcff]
[    1.605559] pci 0000:03:00.0: reg 0x14: [mem 0xddffc000-0xddffffff 64bit]
[    1.605566] pci 0000:03:00.0: reg 0x1c: [mem 0xddf80000-0xddfbffff 64bit]
[    1.605575] pci 0000:03:00.0: reg 0x30: [mem 0xdd000000-0xdd01ffff pref]
[    1.605579] pci 0000:03:00.0: enabling Extended Tags
[    1.605619] pci 0000:03:00.0: supports D1 D2
[    1.605671] pci 0000:00:02.2: PCI bridge to [bus 03]
[    1.605673] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    1.605676] pci 0000:00:02.2:   bridge window [mem 0xdd000000-0xddffffff]
[    1.605711] pci 0000:00:03.0: PCI bridge to [bus 05]
[    1.605750] pci 0000:00:03.2: PCI bridge to [bus 06]
[    1.605802] pci 0000:00:11.0: PCI bridge to [bus 07]
[    1.605845] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    1.606198] pci 0000:09:00.0: [1912:0013] type 01 class 0x060400
[    1.609223] pci 0000:09:00.0: PME# supported from D0 D3hot D3cold
[    1.614346] pci 0000:00:1c.7: PCI bridge to [bus 09-0d]
[    1.614351] pci 0000:00:1c.7:   bridge window [mem 0xde000000-0xdf7fffff]
[    1.614356] pci 0000:00:1c.7:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.615514] pci 0000:0a:00.0: [1912:0013] type 01 class 0x060400
[    1.618996] pci 0000:0a:00.0: PME# supported from D0 D3hot D3cold
[    1.620214] pci 0000:0a:01.0: [1912:0013] type 01 class 0x060400
[    1.623902] pci 0000:0a:01.0: PME# supported from D0 D3hot D3cold
[    1.626637] pci 0000:09:00.0: PCI bridge to [bus 0a-0d]
[    1.626821] pci 0000:09:00.0:   bridge window [mem 0xde000000-0xdf7fffff]
[    1.626946] pci 0000:09:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.628169] pci 0000:0b:00.0: [1912:0012] type 01 class 0x060400
[    1.632703] pci 0000:0a:00.0: PCI bridge to [bus 0b-0c]
[    1.632926] pci 0000:0a:00.0:   bridge window [mem 0xde000000-0xdeffffff]
[    1.633070] pci 0000:0a:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.634123] pci_bus 0000:0c: extended config space not accessible
[    1.634362] pci 0000:0c:00.0: [102b:0534] type 00 class 0x030000
[    1.634850] pci 0000:0c:00.0: reg 0x10: [mem 0xd8000000-0xd8ffffff pref]
[    1.635107] pci 0000:0c:00.0: reg 0x14: [mem 0xdeffc000-0xdeffffff]
[    1.635368] pci 0000:0c:00.0: reg 0x18: [mem 0xde000000-0xde7fffff]
[    1.639556] pci 0000:0b:00.0: PCI bridge to [bus 0c]
[    1.639779] pci 0000:0b:00.0:   bridge window [mem 0xde000000-0xdeffffff]
[    1.639924] pci 0000:0b:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.641167] pci 0000:0a:01.0: PCI bridge to [bus 0d]
[    1.641393] pci 0000:0a:01.0:   bridge window [mem 0xdf700000-0xdf7fffff]
[    1.642487] pci_bus 0000:0e: extended config space not accessible
[    1.642539] pci 0000:00:1e.0: PCI bridge to [bus 0e] (subtractive decode)
[    1.642547] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    1.642548] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    1.642549] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
[    1.642550] pci 0000:00:1e.0:   bridge window [io  0x0d00-0x1fff window] (subtractive decode)
[    1.642551] pci 0000:00:1e.0:   bridge window [io  0xe000-0xffff window] (subtractive decode)
[    1.642552] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    1.642553] pci 0000:00:1e.0:   bridge window [mem 0xd8000000-0xdfffffff window] (subtractive decode)
[    1.642554] pci 0000:00:1e.0:   bridge window [mem 0x3c000000000-0x3ffffffffff window] (subtractive decode)
[    1.642555] pci 0000:00:1e.0:   bridge window [mem 0xfed40000-0xfed44fff window] (subtractive decode)
[    1.642606] pci_bus 0000:00: on NUMA node 0
[    1.644281] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 40-7e])
[    1.644285] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.644411] acpi PNP0A08:01: PCIe AER handled by firmware
[    1.644664] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    1.644665] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.645687] PCI host bridge to bus 0000:40
[    1.645688] pci_bus 0000:40: root bus resource [io  0x2000-0x3fff window]
[    1.645691] pci_bus 0000:40: root bus resource [io  0x4000-0x5fff window]
[    1.645693] pci_bus 0000:40: root bus resource [io  0x6000-0x7fff window]
[    1.645694] pci_bus 0000:40: root bus resource [io  0x8000-0x9fff window]
[    1.645695] pci_bus 0000:40: root bus resource [io  0xa000-0xbfff window]
[    1.645697] pci_bus 0000:40: root bus resource [io  0xc000-0xdfff window]
[    1.645698] pci_bus 0000:40: root bus resource [mem 0xd0000000-0xd7ffffff window]
[    1.645699] pci_bus 0000:40: root bus resource [mem 0x38000000000-0x3bfffffffff window]
[    1.645701] pci_bus 0000:40: root bus resource [bus 40-7e]
[    1.645745] pci 0000:40:01.0: [8086:3c02] type 01 class 0x060400
[    1.645842] pci 0000:40:01.0: PME# supported from D0 D3hot D3cold
[    1.645982] pci 0000:40:02.0: [8086:3c04] type 01 class 0x060400
[    1.646079] pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[    1.646226] pci 0000:40:03.0: [8086:3c08] type 01 class 0x060400
[    1.646272] pci 0000:40:03.0: enabling Extended Tags
[    1.646326] pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[    1.646458] pci 0000:40:03.2: [8086:3c0a] type 01 class 0x060400
[    1.646555] pci 0000:40:03.2: PME# supported from D0 D3hot D3cold
[    1.646689] pci 0000:40:05.0: [8086:3c28] type 00 class 0x088000
[    1.646816] pci 0000:40:05.2: [8086:3c2a] type 00 class 0x088000
[    1.646962] pci 0000:40:01.0: PCI bridge to [bus 41]
[    1.647012] pci 0000:42:00.0: [10de:11fa] type 00 class 0x030000
[    1.647028] pci 0000:42:00.0: reg 0x10: [mem 0xd4000000-0xd4ffffff]
[    1.647036] pci 0000:42:00.0: reg 0x14: [mem 0x3bff0000000-0x3bfffffffff 64bit pref]
[    1.647043] pci 0000:42:00.0: reg 0x1c: [mem 0x3bfee000000-0x3bfefffffff 64bit pref]
[    1.647048] pci 0000:42:00.0: reg 0x24: [io  0xdc80-0xdcff]
[    1.647053] pci 0000:42:00.0: reg 0x30: [mem 0xd5000000-0xd507ffff pref]
[    1.647125] pci 0000:42:00.0: 32.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x16 link at 0000:40:02.0 (capable of 126.016 Gb/s with 8.0 GT/s PCIe x16 link)
[    1.647160] pci 0000:42:00.1: [10de:0e0b] type 00 class 0x040300
[    1.647174] pci 0000:42:00.1: reg 0x10: [mem 0xd5ffc000-0xd5ffffff]
[    1.647303] pci 0000:40:02.0: PCI bridge to [bus 42]
[    1.647306] pci 0000:40:02.0:   bridge window [io  0xd000-0xdfff]
[    1.647309] pci 0000:40:02.0:   bridge window [mem 0xd4000000-0xd5ffffff]
[    1.647313] pci 0000:40:02.0:   bridge window [mem 0x3bfee000000-0x3bfffffffff 64bit pref]
[    1.647350] pci 0000:40:03.0: PCI bridge to [bus 43]
[    1.647392] pci 0000:40:03.2: PCI bridge to [bus 44]
[    1.647423] pci_bus 0000:40: on NUMA node 1
[    1.647526] ACPI: PCI Root Bridge [P0B1] (domain 0000 [bus 3f])
[    1.647530] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.647656] acpi PNP0A08:02: PCIe AER handled by firmware
[    1.647913] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    1.647914] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.647988] PCI host bridge to bus 0000:3f
[    1.647989] pci_bus 0000:3f: root bus resource [bus 3f]
[    1.647997] pci 0000:3f:08.0: [8086:3c80] type 00 class 0x088000
[    1.648052] pci 0000:3f:09.0: [8086:3c90] type 00 class 0x088000
[    1.648109] pci 0000:3f:0a.0: [8086:3cc0] type 00 class 0x088000
[    1.648151] pci 0000:3f:0a.1: [8086:3cc1] type 00 class 0x088000
[    1.648192] pci 0000:3f:0a.2: [8086:3cc2] type 00 class 0x088000
[    1.648234] pci 0000:3f:0a.3: [8086:3cd0] type 00 class 0x088000
[    1.648280] pci 0000:3f:0b.0: [8086:3ce0] type 00 class 0x088000
[    1.648320] pci 0000:3f:0b.3: [8086:3ce3] type 00 class 0x088000
[    1.648375] pci 0000:3f:0c.0: [8086:3ce8] type 00 class 0x088000
[    1.648416] pci 0000:3f:0c.1: [8086:3ce8] type 00 class 0x088000
[    1.648468] pci 0000:3f:0c.2: [8086:3ce8] type 00 class 0x088000
[    1.648508] pci 0000:3f:0c.3: [8086:3ce8] type 00 class 0x088000
[    1.648552] pci 0000:3f:0c.6: [8086:3cf4] type 00 class 0x088000
[    1.648591] pci 0000:3f:0c.7: [8086:3cf6] type 00 class 0x088000
[    1.648632] pci 0000:3f:0d.0: [8086:3ce8] type 00 class 0x088000
[    1.648671] pci 0000:3f:0d.1: [8086:3ce8] type 00 class 0x088000
[    1.648714] pci 0000:3f:0d.2: [8086:3ce8] type 00 class 0x088000
[    1.648754] pci 0000:3f:0d.3: [8086:3ce8] type 00 class 0x088000
[    1.648802] pci 0000:3f:0d.6: [8086:3cf5] type 00 class 0x088000
[    1.648854] pci 0000:3f:0e.0: [8086:3ca0] type 00 class 0x088000
[    1.648899] pci 0000:3f:0e.1: [8086:3c46] type 00 class 0x110100
[    1.648946] pci 0000:3f:0f.0: [8086:3ca8] type 00 class 0x088000
[    1.649004] pci 0000:3f:0f.1: [8086:3c71] type 00 class 0x088000
[    1.649063] pci 0000:3f:0f.2: [8086:3caa] type 00 class 0x088000
[    1.649124] pci 0000:3f:0f.3: [8086:3cab] type 00 class 0x088000
[    1.649180] pci 0000:3f:0f.4: [8086:3cac] type 00 class 0x088000
[    1.649246] pci 0000:3f:0f.5: [8086:3cad] type 00 class 0x088000
[    1.649302] pci 0000:3f:0f.6: [8086:3cae] type 00 class 0x088000
[    1.649348] pci 0000:3f:10.0: [8086:3cb0] type 00 class 0x088000
[    1.649410] pci 0000:3f:10.1: [8086:3cb1] type 00 class 0x088000
[    1.649471] pci 0000:3f:10.2: [8086:3cb2] type 00 class 0x088000
[    1.649527] pci 0000:3f:10.3: [8086:3cb3] type 00 class 0x088000
[    1.649586] pci 0000:3f:10.4: [8086:3cb4] type 00 class 0x088000
[    1.649643] pci 0000:3f:10.5: [8086:3cb5] type 00 class 0x088000
[    1.649714] pci 0000:3f:10.6: [8086:3cb6] type 00 class 0x088000
[    1.649774] pci 0000:3f:10.7: [8086:3cb7] type 00 class 0x088000
[    1.649833] pci 0000:3f:11.0: [8086:3cb8] type 00 class 0x088000
[    1.649881] pci 0000:3f:13.0: [8086:3ce4] type 00 class 0x088000
[    1.649924] pci 0000:3f:13.1: [8086:3c43] type 00 class 0x110100
[    1.649967] pci 0000:3f:13.4: [8086:3ce6] type 00 class 0x110100
[    1.650007] pci 0000:3f:13.5: [8086:3c44] type 00 class 0x110100
[    1.650048] pci 0000:3f:13.6: [8086:3c45] type 00 class 0x088000
[    1.650116] pci_bus 0000:3f: on NUMA node 0
[    1.650190] ACPI: PCI Root Bridge [P1B1] (domain 0000 [bus 7f])
[    1.650193] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    1.650326] acpi PNP0A08:03: PCIe AER handled by firmware
[    1.650579] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    1.650582] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    1.650626] PCI host bridge to bus 0000:7f
[    1.650628] pci_bus 0000:7f: root bus resource [bus 7f]
[    1.650637] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000
[    1.650692] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000
[    1.650749] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000
[    1.650791] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000
[    1.650834] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000
[    1.650876] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000
[    1.650924] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000
[    1.650966] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000
[    1.651018] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000
[    1.651061] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000
[    1.651107] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000
[    1.651149] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000
[    1.651192] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000
[    1.651234] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000
[    1.651278] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000
[    1.651324] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000
[    1.651376] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000
[    1.651418] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000
[    1.651461] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000
[    1.651507] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000
[    1.651558] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100
[    1.651622] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000
[    1.651687] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000
[    1.651753] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000
[    1.651825] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000
[    1.651891] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000
[    1.651956] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000
[    1.652020] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000
[    1.652074] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000
[    1.652142] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000
[    1.652204] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000
[    1.652270] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000
[    1.652345] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000
[    1.652411] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000
[    1.652479] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000
[    1.652542] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000
[    1.652603] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000
[    1.652657] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000
[    1.652700] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100
[    1.652745] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100
[    1.652799] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100
[    1.652846] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000
[    1.652894] pci_bus 0000:7f: on NUMA node 1
[    1.653084] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 11 14 *15)
[    1.653168] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 11 *14 15)
[    1.653251] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 11 14 15) *0, disabled.
[    1.653333] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *11 14 15)
[    1.653414] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 11 14 15)
[    1.653494] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 6 7 11 *14 15)
[    1.653575] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 *6 7 11 14 15)
[    1.653655] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 11 *14 15)
[    1.653834] iommu: Default domain type: Passthrough (set via kernel command line)
[    1.653927] SCSI subsystem initialized
[    1.653945] libata version 3.00 loaded.
[    1.653945] pci 0000:0c:00.0: vgaarb: setting as boot VGA device
[    1.653945] pci 0000:0c:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    1.653945] pci 0000:42:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.653945] pci 0000:0c:00.0: vgaarb: bridge control possible
[    1.653945] pci 0000:42:00.0: vgaarb: bridge control possible
[    1.653945] vgaarb: loaded
[    1.653945] ACPI: bus type USB registered
[    1.653945] usbcore: registered new interface driver usbfs
[    1.653945] usbcore: registered new interface driver hub
[    1.653949] usbcore: registered new device driver usb
[    1.653975] pps_core: LinuxPPS API ver. 1 registered
[    1.653975] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <[email protected]>
[    1.653977] PTP clock support registered
[    1.654006] EDAC MC: Ver: 3.0.0
[    1.654422] PCI: Using ACPI for IRQ routing
[    1.656362] PCI: pci_cache_line_size set to 64 bytes
[    1.656849] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
[    1.656863] e820: reserve RAM buffer [mem 0x7d2f0000-0x7fffffff]
[    1.657123] NetLabel: Initializing
[    1.657123] NetLabel:  domain hash size = 128
[    1.657124] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.657139] NetLabel:  unlabeled traffic allowed by default
[    1.657811] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    1.657815] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    1.662776] clocksource: Switched to clocksource tsc-early
[    1.675618] *** VALIDATE bpf ***
[    1.675759] VFS: Disk quotas dquot_6.6.0
[    1.675801] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.675824] *** VALIDATE ramfs ***
[    1.675840] *** VALIDATE hugetlbfs ***
[    1.675964] AppArmor: AppArmor Filesystem Enabled
[    1.675996] pnp: PnP ACPI init
[    1.676255] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.676297] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.676523] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.676746] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.677163] system 00:04: [io  0x0800-0x087f] has been reserved
[    1.677165] system 00:04: [io  0x0880-0x08ff] has been reserved
[    1.677166] system 00:04: [io  0x0900-0x091f] has been reserved
[    1.677167] system 00:04: [io  0x0920-0x0923] has been reserved
[    1.677169] system 00:04: [io  0x0924] has been reserved
[    1.677170] system 00:04: [io  0x0370-0x0377] has been reserved
[    1.677171] system 00:04: [io  0x0ca0-0x0ca7] has been reserved
[    1.677172] system 00:04: [io  0x0ca9-0x0cab] has been reserved
[    1.677173] system 00:04: [io  0x0cad-0x0caf] has been reserved
[    1.677174] system 00:04: [io  0x0cb0-0x0cbf] has been reserved
[    1.677178] system 00:04: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.677264] system 00:05: [io  0x0ca8] has been reserved
[    1.677266] system 00:05: [io  0x0cac] has been reserved
[    1.677269] system 00:05: Plug and Play ACPI device, IDs IPI0001 PNP0c01 (active)
[    1.677715] system 00:06: [mem 0xe0000000-0xe3efffff] has been reserved
[    1.677719] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.677944] system 00:07: [mem 0xe4000000-0xe7ffffff] has been reserved
[    1.677948] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.678036] system 00:08: [mem 0xe3f00000-0xe3ffffff] has been reserved
[    1.678039] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.678142] system 00:09: [mem 0xdf900000-0xdf901fff] could not be reserved
[    1.678146] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.678271] system 00:0a: [mem 0xd6000000-0xd6001fff] could not be reserved
[    1.678275] system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.678484] pnp: PnP ACPI: found 11 devices
[    1.679812] thermal_sys: Registered thermal governor 'fair_share'
[    1.679813] thermal_sys: Registered thermal governor 'bang_bang'
[    1.679814] thermal_sys: Registered thermal governor 'step_wise'
[    1.679814] thermal_sys: Registered thermal governor 'user_space'
[    1.679815] thermal_sys: Registered thermal governor 'power_allocator'
[    1.684309] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.684337] pci 0000:02:00.1: can't claim BAR 6 [mem 0xdc000000-0xdc03ffff pref]: address conflict with 0000:02:00.0 [mem 0xdc000000-0xdc03ffff pref]
[    1.684339] pci 0000:01:00.1: can't claim BAR 6 [mem 0xdc800000-0xdc83ffff pref]: address conflict with 0000:01:00.0 [mem 0xdc800000-0xdc83ffff pref]
[    1.684353] pci 0000:02:00.1: BAR 6: assigned [mem 0xdc040000-0xdc07ffff pref]
[    1.684355] pci 0000:00:01.0: PCI bridge to [bus 02]
[    1.684359] pci 0000:00:01.0:   bridge window [mem 0xdc000000-0xdc7fffff]
[    1.684361] pci 0000:00:01.0:   bridge window [mem 0xd9000000-0xd90fffff 64bit pref]
[    1.684366] pci 0000:01:00.1: BAR 6: assigned [mem 0xdc840000-0xdc87ffff pref]
[    1.684367] pci 0000:00:01.1: PCI bridge to [bus 01]
[    1.684370] pci 0000:00:01.1:   bridge window [mem 0xdc800000-0xdcffffff]
[    1.684373] pci 0000:00:01.1:   bridge window [mem 0xd9100000-0xd91fffff 64bit pref]
[    1.684376] pci 0000:00:02.0: PCI bridge to [bus 04]
[    1.684384] pci 0000:00:02.2: PCI bridge to [bus 03]
[    1.684386] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    1.684389] pci 0000:00:02.2:   bridge window [mem 0xdd000000-0xddffffff]
[    1.684394] pci 0000:00:03.0: PCI bridge to [bus 05]
[    1.684401] pci 0000:00:03.2: PCI bridge to [bus 06]
[    1.684409] pci 0000:00:11.0: PCI bridge to [bus 07]
[    1.684420] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    1.684430] pci 0000:0b:00.0: PCI bridge to [bus 0c]
[    1.684572] pci 0000:0b:00.0:   bridge window [mem 0xde000000-0xdeffffff]
[    1.684666] pci 0000:0b:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.684861] pci 0000:0a:00.0: PCI bridge to [bus 0b-0c]
[    1.685005] pci 0000:0a:00.0:   bridge window [mem 0xde000000-0xdeffffff]
[    1.685099] pci 0000:0a:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.685293] pci 0000:0a:01.0: PCI bridge to [bus 0d]
[    1.685437] pci 0000:0a:01.0:   bridge window [mem 0xdf700000-0xdf7fffff]
[    1.685790] pci 0000:09:00.0: PCI bridge to [bus 0a-0d]
[    1.685917] pci 0000:09:00.0:   bridge window [mem 0xde000000-0xdf7fffff]
[    1.686001] pci 0000:09:00.0:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686241] pci 0000:00:1c.7: PCI bridge to [bus 09-0d]
[    1.686253] pci 0000:00:1c.7:   bridge window [mem 0xde000000-0xdf7fffff]
[    1.686256] pci 0000:00:1c.7:   bridge window [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686260] pci 0000:00:1e.0: PCI bridge to [bus 0e]
[    1.686269] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    1.686271] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    1.686272] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    1.686272] pci_bus 0000:00: resource 7 [io  0x0d00-0x1fff window]
[    1.686273] pci_bus 0000:00: resource 8 [io  0xe000-0xffff window]
[    1.686274] pci_bus 0000:00: resource 9 [mem 0x000a0000-0x000bffff window]
[    1.686275] pci_bus 0000:00: resource 10 [mem 0xd8000000-0xdfffffff window]
[    1.686276] pci_bus 0000:00: resource 11 [mem 0x3c000000000-0x3ffffffffff window]
[    1.686277] pci_bus 0000:00: resource 12 [mem 0xfed40000-0xfed44fff window]
[    1.686278] pci_bus 0000:02: resource 1 [mem 0xdc000000-0xdc7fffff]
[    1.686279] pci_bus 0000:02: resource 2 [mem 0xd9000000-0xd90fffff 64bit pref]
[    1.686280] pci_bus 0000:01: resource 1 [mem 0xdc800000-0xdcffffff]
[    1.686281] pci_bus 0000:01: resource 2 [mem 0xd9100000-0xd91fffff 64bit pref]
[    1.686282] pci_bus 0000:03: resource 0 [io  0xf000-0xffff]
[    1.686282] pci_bus 0000:03: resource 1 [mem 0xdd000000-0xddffffff]
[    1.686284] pci_bus 0000:09: resource 1 [mem 0xde000000-0xdf7fffff]
[    1.686284] pci_bus 0000:09: resource 2 [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686285] pci_bus 0000:0a: resource 1 [mem 0xde000000-0xdf7fffff]
[    1.686286] pci_bus 0000:0a: resource 2 [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686287] pci_bus 0000:0b: resource 1 [mem 0xde000000-0xdeffffff]
[    1.686288] pci_bus 0000:0b: resource 2 [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686289] pci_bus 0000:0c: resource 1 [mem 0xde000000-0xdeffffff]
[    1.686290] pci_bus 0000:0c: resource 2 [mem 0xd8000000-0xd8ffffff 64bit pref]
[    1.686291] pci_bus 0000:0d: resource 1 [mem 0xdf700000-0xdf7fffff]
[    1.686292] pci_bus 0000:0e: resource 4 [io  0x0000-0x03af window]
[    1.686292] pci_bus 0000:0e: resource 5 [io  0x03e0-0x0cf7 window]
[    1.686293] pci_bus 0000:0e: resource 6 [io  0x03b0-0x03df window]
[    1.686294] pci_bus 0000:0e: resource 7 [io  0x0d00-0x1fff window]
[    1.686295] pci_bus 0000:0e: resource 8 [io  0xe000-0xffff window]
[    1.686296] pci_bus 0000:0e: resource 9 [mem 0x000a0000-0x000bffff window]
[    1.686297] pci_bus 0000:0e: resource 10 [mem 0xd8000000-0xdfffffff window]
[    1.686298] pci_bus 0000:0e: resource 11 [mem 0x3c000000000-0x3ffffffffff window]
[    1.686299] pci_bus 0000:0e: resource 12 [mem 0xfed40000-0xfed44fff window]
[    1.686327] pci 0000:40:01.0: PCI bridge to [bus 41]
[    1.686336] pci 0000:40:02.0: PCI bridge to [bus 42]
[    1.686338] pci 0000:40:02.0:   bridge window [io  0xd000-0xdfff]
[    1.686341] pci 0000:40:02.0:   bridge window [mem 0xd4000000-0xd5ffffff]
[    1.686344] pci 0000:40:02.0:   bridge window [mem 0x3bfee000000-0x3bfffffffff 64bit pref]
[    1.686348] pci 0000:40:03.0: PCI bridge to [bus 43]
[    1.686356] pci 0000:40:03.2: PCI bridge to [bus 44]
[    1.686364] pci_bus 0000:40: resource 4 [io  0x2000-0x3fff window]
[    1.686365] pci_bus 0000:40: resource 5 [io  0x4000-0x5fff window]
[    1.686366] pci_bus 0000:40: resource 6 [io  0x6000-0x7fff window]
[    1.686367] pci_bus 0000:40: resource 7 [io  0x8000-0x9fff window]
[    1.686367] pci_bus 0000:40: resource 8 [io  0xa000-0xbfff window]
[    1.686368] pci_bus 0000:40: resource 9 [io  0xc000-0xdfff window]
[    1.686369] pci_bus 0000:40: resource 10 [mem 0xd0000000-0xd7ffffff window]
[    1.686370] pci_bus 0000:40: resource 11 [mem 0x38000000000-0x3bfffffffff window]
[    1.686371] pci_bus 0000:42: resource 0 [io  0xd000-0xdfff]
[    1.686372] pci_bus 0000:42: resource 1 [mem 0xd4000000-0xd5ffffff]
[    1.686373] pci_bus 0000:42: resource 2 [mem 0x3bfee000000-0x3bfffffffff 64bit pref]
[    1.686458] NET: Registered protocol family 2
[    1.686994] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[    1.689498] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    1.690675] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc)
[    1.691461] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[    1.691542] TCP: Hash tables configured (established 524288 bind 65536)
[    1.692147] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    1.692860] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[    1.693181] NET: Registered protocol family 1
[    1.693185] NET: Registered protocol family 44
[    1.693204] pci 0000:00:05.0: disabled boot interrupts on device [8086:3c28]
[    1.713933] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x650 took 20227 usecs
[    1.714324] pci 0000:03:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[    1.714680] pci 0000:0c:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    1.714771] pci 0000:40:05.0: disabled boot interrupts on device [8086:3c28]
[    1.714800] pci 0000:42:00.1: D0 power state depends on 0000:42:00.0
[    1.714857] PCI: CLS 64 bytes, default 64
[    1.714967] Trying to unpack rootfs image as initramfs...
[    2.627118] Freeing initrd memory: 46148K
[    2.627683] DMAR: dmar0: Using Queued invalidation
[    2.627689] DMAR: dmar1: Using Queued invalidation
[    2.628217] pci 0000:00:00.0: Adding to iommu group 0
[    2.628250] pci 0000:00:01.0: Adding to iommu group 1
[    2.628279] pci 0000:00:01.1: Adding to iommu group 2
[    2.628308] pci 0000:00:02.0: Adding to iommu group 3
[    2.628340] pci 0000:00:02.2: Adding to iommu group 4
[    2.628368] pci 0000:00:03.0: Adding to iommu group 5
[    2.628397] pci 0000:00:03.2: Adding to iommu group 6
[    2.628420] pci 0000:00:05.0: Adding to iommu group 7
[    2.628446] pci 0000:00:05.2: Adding to iommu group 8
[    2.628470] pci 0000:00:11.0: Adding to iommu group 9
[    2.628530] pci 0000:00:16.0: Adding to iommu group 10
[    2.628559] pci 0000:00:16.1: Adding to iommu group 10
[    2.628584] pci 0000:00:1a.0: Adding to iommu group 11
[    2.628607] pci 0000:00:1c.0: Adding to iommu group 12
[    2.628629] pci 0000:00:1c.7: Adding to iommu group 13
[    2.628651] pci 0000:00:1d.0: Adding to iommu group 14
[    2.628677] pci 0000:00:1e.0: Adding to iommu group 15
[    2.629383] pci 0000:00:1e.0: Using iommu dma mapping
[    2.629455] pci 0000:00:1f.0: Adding to iommu group 16
[    2.629478] pci 0000:00:1f.2: Adding to iommu group 16
[    2.629501] pci 0000:00:1f.5: Adding to iommu group 16
[    2.629576] pci 0000:01:00.0: Adding to iommu group 17
[    2.629620] pci 0000:01:00.1: Adding to iommu group 17
[    2.629700] pci 0000:02:00.0: Adding to iommu group 18
[    2.629740] pci 0000:02:00.1: Adding to iommu group 18
[    2.629772] pci 0000:03:00.0: Adding to iommu group 19
[    2.629829] pci 0000:09:00.0: Adding to iommu group 20
[    2.629916] pci 0000:0a:00.0: Adding to iommu group 21
[    2.630037] pci 0000:0a:01.0: Adding to iommu group 22
[    2.630152] pci 0000:0b:00.0: Adding to iommu group 21
[    2.630622] pci 0000:0b:00.0: DMAR: Device uses a private dma domain.
[    2.630633] pci 0000:0c:00.0: Adding to iommu group 21
[    2.631047] pci 0000:0c:00.0: DMAR: Device uses a private dma domain.
[    2.631283] pci 0000:3f:08.0: Adding to iommu group 23
[    2.631322] pci 0000:3f:09.0: Adding to iommu group 24
[    2.631410] pci 0000:3f:0a.0: Adding to iommu group 25
[    2.631436] pci 0000:3f:0a.1: Adding to iommu group 25
[    2.631461] pci 0000:3f:0a.2: Adding to iommu group 25
[    2.631489] pci 0000:3f:0a.3: Adding to iommu group 25
[    2.631543] pci 0000:3f:0b.0: Adding to iommu group 26
[    2.631569] pci 0000:3f:0b.3: Adding to iommu group 26
[    2.631685] pci 0000:3f:0c.0: Adding to iommu group 27
[    2.631711] pci 0000:3f:0c.1: Adding to iommu group 27
[    2.631738] pci 0000:3f:0c.2: Adding to iommu group 27
[    2.631768] pci 0000:3f:0c.3: Adding to iommu group 27
[    2.631795] pci 0000:3f:0c.6: Adding to iommu group 27
[    2.631821] pci 0000:3f:0c.7: Adding to iommu group 27
[    2.631920] pci 0000:3f:0d.0: Adding to iommu group 28
[    2.631947] pci 0000:3f:0d.1: Adding to iommu group 28
[    2.631975] pci 0000:3f:0d.2: Adding to iommu group 28
[    2.632004] pci 0000:3f:0d.3: Adding to iommu group 28
[    2.632032] pci 0000:3f:0d.6: Adding to iommu group 28
[    2.632092] pci 0000:3f:0e.0: Adding to iommu group 29
[    2.632119] pci 0000:3f:0e.1: Adding to iommu group 29
[    2.632142] pci 0000:3f:0f.0: Adding to iommu group 30
[    2.632168] pci 0000:3f:0f.1: Adding to iommu group 31
[    2.632191] pci 0000:3f:0f.2: Adding to iommu group 32
[    2.632214] pci 0000:3f:0f.3: Adding to iommu group 33
[    2.632237] pci 0000:3f:0f.4: Adding to iommu group 34
[    2.632263] pci 0000:3f:0f.5: Adding to iommu group 35
[    2.632305] pci 0000:3f:0f.6: Adding to iommu group 36
[    2.632328] pci 0000:3f:10.0: Adding to iommu group 37
[    2.632350] pci 0000:3f:10.1: Adding to iommu group 38
[    2.632376] pci 0000:3f:10.2: Adding to iommu group 39
[    2.632399] pci 0000:3f:10.3: Adding to iommu group 40
[    2.632421] pci 0000:3f:10.4: Adding to iommu group 41
[    2.632451] pci 0000:3f:10.5: Adding to iommu group 42
[    2.632476] pci 0000:3f:10.6: Adding to iommu group 43
[    2.632498] pci 0000:3f:10.7: Adding to iommu group 44
[    2.632537] pci 0000:3f:11.0: Adding to iommu group 45
[    2.632641] pci 0000:3f:13.0: Adding to iommu group 46
[    2.632670] pci 0000:3f:13.1: Adding to iommu group 46
[    2.632703] pci 0000:3f:13.4: Adding to iommu group 46
[    2.632735] pci 0000:3f:13.5: Adding to iommu group 46
[    2.632765] pci 0000:3f:13.6: Adding to iommu group 46
[    2.632802] pci 0000:40:01.0: Adding to iommu group 47
[    2.632837] pci 0000:40:02.0: Adding to iommu group 48
[    2.632867] pci 0000:40:03.0: Adding to iommu group 49
[    2.632897] pci 0000:40:03.2: Adding to iommu group 50
[    2.632921] pci 0000:40:05.0: Adding to iommu group 51
[    2.632947] pci 0000:40:05.2: Adding to iommu group 52
[    2.633021] pci 0000:42:00.0: Adding to iommu group 53
[    2.633063] pci 0000:42:00.1: Adding to iommu group 53
[    2.633112] pci 0000:7f:08.0: Adding to iommu group 54
[    2.633156] pci 0000:7f:09.0: Adding to iommu group 55
[    2.633243] pci 0000:7f:0a.0: Adding to iommu group 56
[    2.633276] pci 0000:7f:0a.1: Adding to iommu group 56
[    2.633308] pci 0000:7f:0a.2: Adding to iommu group 56
[    2.633340] pci 0000:7f:0a.3: Adding to iommu group 56
[    2.633398] pci 0000:7f:0b.0: Adding to iommu group 57
[    2.633432] pci 0000:7f:0b.3: Adding to iommu group 57
[    2.633551] pci 0000:7f:0c.0: Adding to iommu group 58
[    2.633584] pci 0000:7f:0c.1: Adding to iommu group 58
[    2.633617] pci 0000:7f:0c.2: Adding to iommu group 58
[    2.633650] pci 0000:7f:0c.3: Adding to iommu group 58
[    2.633687] pci 0000:7f:0c.6: Adding to iommu group 58
[    2.633725] pci 0000:7f:0c.7: Adding to iommu group 58
[    2.633829] pci 0000:7f:0d.0: Adding to iommu group 59
[    2.633865] pci 0000:7f:0d.1: Adding to iommu group 59
[    2.633902] pci 0000:7f:0d.2: Adding to iommu group 59
[    2.633940] pci 0000:7f:0d.3: Adding to iommu group 59
[    2.633975] pci 0000:7f:0d.6: Adding to iommu group 59
[    2.634034] pci 0000:7f:0e.0: Adding to iommu group 60
[    2.634070] pci 0000:7f:0e.1: Adding to iommu group 60
[    2.634094] pci 0000:7f:0f.0: Adding to iommu group 61
[    2.634118] pci 0000:7f:0f.1: Adding to iommu group 62
[    2.634145] pci 0000:7f:0f.2: Adding to iommu group 63
[    2.634169] pci 0000:7f:0f.3: Adding to iommu group 64
[    2.634194] pci 0000:7f:0f.4: Adding to iommu group 65
[    2.634218] pci 0000:7f:0f.5: Adding to iommu group 66
[    2.634263] pci 0000:7f:0f.6: Adding to iommu group 67
[    2.634287] pci 0000:7f:10.0: Adding to iommu group 68
[    2.634310] pci 0000:7f:10.1: Adding to iommu group 69
[    2.634337] pci 0000:7f:10.2: Adding to iommu group 70
[    2.634362] pci 0000:7f:10.3: Adding to iommu group 71
[    2.634386] pci 0000:7f:10.4: Adding to iommu group 72
[    2.634410] pci 0000:7f:10.5: Adding to iommu group 73
[    2.634441] pci 0000:7f:10.6: Adding to iommu group 74
[    2.634465] pci 0000:7f:10.7: Adding to iommu group 75
[    2.634504] pci 0000:7f:11.0: Adding to iommu group 76
[    2.634606] pci 0000:7f:13.0: Adding to iommu group 77
[    2.634648] pci 0000:7f:13.1: Adding to iommu group 77
[    2.634686] pci 0000:7f:13.4: Adding to iommu group 77
[    2.634725] pci 0000:7f:13.5: Adding to iommu group 77
[    2.634763] pci 0000:7f:13.6: Adding to iommu group 77
[    2.634768] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    2.638591] check: Scanning for low memory corruption every 60 seconds
[    2.639674] Initialise system trusted keyrings
[    2.639691] Key type blacklist registered
[    2.639746] workingset: timestamp_bits=36 max_order=26 bucket_order=0
[    2.641145] zbud: loaded
[    2.641639] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    2.641832] fuse: init (API version 7.31)
[    2.641854] *** VALIDATE fuse ***
[    2.641856] *** VALIDATE fuse ***
[    2.641987] Platform Keyring initialized
[    2.645105] Key type asymmetric registered
[    2.645106] Asymmetric key parser 'x509' registered
[    2.645114] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    2.645166] io scheduler mq-deadline registered
[    2.646178] pcieport 0000:00:01.0: PME: Signaling with IRQ 25
[    2.646528] pcieport 0000:00:01.1: PME: Signaling with IRQ 26
[    2.646880] pcieport 0000:00:02.0: PME: Signaling with IRQ 27
[    2.647225] pcieport 0000:00:02.2: PME: Signaling with IRQ 28
[    2.647565] pcieport 0000:00:03.0: PME: Signaling with IRQ 29
[    2.647911] pcieport 0000:00:03.2: PME: Signaling with IRQ 30
[    2.648211] pcieport 0000:00:11.0: PME: Signaling with IRQ 31
[    2.648326] pcieport 0000:00:1c.0: PME: Signaling with IRQ 32
[    2.648611] pcieport 0000:00:1c.7: PME: Signaling with IRQ 33
[    2.653479] pcieport 0000:40:01.0: PME: Signaling with IRQ 35
[    2.654154] pcieport 0000:40:02.0: PME: Signaling with IRQ 36
[    2.654799] pcieport 0000:40:03.0: PME: Signaling with IRQ 37
[    2.655433] pcieport 0000:40:03.2: PME: Signaling with IRQ 38
[    2.655804] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    2.655888] intel_idle: MWAIT substates: 0x21120
[    2.655888] intel_idle: v0.4.1 model 0x2D
[    2.658441] intel_idle: lapic_timer_reliable_states 0xffffffff
[    2.658577] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    2.658633] ACPI: Power Button [PWRF]
[    2.659876] ERST: Error Record Serialization Table (ERST) support is initialized.
[    2.659878] pstore: Registered erst as persistent store backend
[    2.660114] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    2.660259] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    2.680727] 00:02: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    2.701372] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    2.703694] Linux agpgart interface v0.103
[    2.861788] loop: module loaded
[    2.862673] ata_piix 0000:00:1f.2: version 2.13
[    2.862921] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    2.863326] ata_piix 0000:00:1f.2: DMAR: 32bit DMA uses non-identity mapping
[    2.863789] scsi host0: ata_piix
[    2.864067] scsi host1: ata_piix
[    2.864113] ata1: SATA max UDMA/133 cmd 0xecd0 ctl 0xecf0 bmdma 0xec90 irq 20
[    2.864116] ata2: SATA max UDMA/133 cmd 0xecd8 ctl 0xecf4 bmdma 0xec98 irq 20
[    2.864443] ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
[    2.864830] ata_piix 0000:00:1f.5: DMAR: 32bit DMA uses non-identity mapping
[    2.865364] scsi host2: ata_piix
[    2.865593] scsi host3: ata_piix
[    2.865639] ata3: SATA max UDMA/133 cmd 0xece0 ctl 0xecf8 bmdma 0xecb0 irq 21
[    2.865641] ata4: SATA max UDMA/133 cmd 0xece8 ctl 0xecfc bmdma 0xecb8 irq 21
[    2.865785] tun: Universal TUN/TAP device driver, 1.6
[    2.865847] PPP generic driver version 2.4.2
[    2.865988] i8042: PNP: No PS/2 controller found.
[    2.866027] mousedev: PS/2 mouse device common for all mice
[    2.866094] rtc_cmos 00:01: RTC can wake from S4
[    2.866262] rtc_cmos 00:01: registered as rtc0
[    2.866276] rtc_cmos 00:01: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    2.866282] i2c /dev entries driver
[    2.866323] device-mapper: uevent: version 1.0.3
[    2.866376] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: [email protected]
[    2.866394] platform eisa.0: Probing EISA bus 0
[    2.866395] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    2.866397] platform eisa.0: Cannot allocate resource for EISA slot 1
[    2.866398] platform eisa.0: Cannot allocate resource for EISA slot 2
[    2.866399] platform eisa.0: Cannot allocate resource for EISA slot 3
[    2.866400] platform eisa.0: Cannot allocate resource for EISA slot 4
[    2.866401] platform eisa.0: Cannot allocate resource for EISA slot 5
[    2.866401] platform eisa.0: Cannot allocate resource for EISA slot 6
[    2.866402] platform eisa.0: Cannot allocate resource for EISA slot 7
[    2.866403] platform eisa.0: Cannot allocate resource for EISA slot 8
[    2.866404] platform eisa.0: EISA: Detected 0 cards
[    2.866409] intel_pstate: Intel P-state driver initializing
[    2.869747] ledtrig-cpu: registered to indicate activity on CPUs
[    2.869859] drop_monitor: Initializing network drop monitor service
[    2.870062] NET: Registered protocol family 10
[    2.877072] Segment Routing with IPv6
[    2.877088] NET: Registered protocol family 17
[    2.877103] Bridge firewalling registered
[    2.877137] Key type dns_resolver registered
[    2.880979] RAS: Correctable Errors collector initialized.
[    2.881005] microcode: sig=0x206d7, pf=0x1, revision=0x713
[    2.882256] microcode: Microcode Update Driver: v2.2.
[    2.882260] IPI shorthand broadcast: enabled
[    2.882268] sched_clock: Marking stable (2873257063, 8995858)->(2930784719, -48531798)
[    2.882556] registered taskstats version 1
[    2.882565] Loading compiled-in X.509 certificates
[    2.882778] zswap: loaded using pool lzo/zbud
[    2.883229] Key type ._fscrypt registered
[    2.883230] Key type .fscrypt registered
[    2.883382] pstore: Using crash dump compression: deflate
[    2.889195] Key type big_key registered
[    2.891808] Key type encrypted registered
[    2.891810] AppArmor: AppArmor sha1 policy hashing enabled
[    2.891817] ima: No TPM chip found, activating TPM-bypass!
[    2.891829] ima: Allocated hash algorithm: sha1
[    2.891836] ima: No architecture policies found
[    2.891846] evm: Initialising EVM extended attributes:
[    2.891846] evm: security.selinux
[    2.891847] evm: security.SMACK64
[    2.891847] evm: security.SMACK64EXEC
[    2.891848] evm: security.SMACK64TRANSMUTE
[    2.891848] evm: security.SMACK64MMAP
[    2.891849] evm: security.apparmor
[    2.891849] evm: security.ima
[    2.891850] evm: security.capability
[    2.891850] evm: HMAC attrs: 0x1
[    2.894021] PM:   Magic number: 7:1:625
[    2.894254] rtc_cmos 00:01: setting system clock to 2023-05-21T08:38:01 UTC (1684658281)
[    3.191892] ata4: SATA link down (SStatus 0 SControl 300)
[    3.337788] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    3.357937] ata3.00: ATAPI: TSSTcorp DVD-ROM SN-108BB, D150, max UDMA/100
[    3.397940] ata3.00: configured for UDMA/100
[    3.504046] ata2.00: SATA link down (SStatus 0 SControl 300)
[    3.504064] ata2.01: SATA link down (SStatus 0 SControl 300)
[    3.515089] ata1.00: SATA link down (SStatus 0 SControl 300)
[    3.515108] ata1.01: SATA link down (SStatus 0 SControl 300)
[    3.518506] scsi 2:0:0:0: CD-ROM            TSSTcorp DVD-ROM SN-108BB D150 PQ: 0 ANSI: 5
[    3.607287] sr 2:0:0:0: [sr0] scsi3-mmc drive: 24x/24x cd/rw xa/form2 cdda tray
[    3.607291] cdrom: Uniform CD-ROM driver Revision: 3.20
[    3.621846] sr 2:0:0:0: Attached scsi CD-ROM sr0
[    3.622078] sr 2:0:0:0: Attached scsi generic sg0 type 5
[    3.625473] Freeing unused decrypted memory: 2040K
[    3.626944] Freeing unused kernel image memory: 2728K
[    3.637780] Write protecting the kernel read-only data: 26624k
[    3.639449] Freeing unused kernel image memory: 2008K
[    3.640267] Freeing unused kernel image memory: 1056K
[    3.657742] tsc: Refined TSC clocksource calibration: 2899.999 MHz
[    3.657776] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x29cd420d9ea, max_idle_ns: 440795262284 ns
[    3.672908] clocksource: Switched to clocksource tsc
[    3.673051] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    3.673053] x86/mm: Checking user space page tables
[    3.698503] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    3.698514] Run /init as init process
[    4.068039] tg3.c:v3.137 (May 11, 2014)
[    4.072233] megasas: 07.713.01.00-rc1
[    4.072855] megaraid_sas 0000:03:00.0: BAR:0x1  BAR's base_addr(phys):0x00000000ddffc000  mapped virt_addr:0x(____ptrval____)
[    4.072861] megaraid_sas 0000:03:00.0: FW now in Ready state
[    4.072867] megaraid_sas 0000:03:00.0: 63 bit DMA mask and 32 bit consistent mask
[    4.074560] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    4.074631] megaraid_sas 0000:03:00.0: Using iommu dma mapping
[    4.074636] megaraid_sas 0000:03:00.0: DMAR: 32bit DMA uses non-identity mapping
[    4.075120] ehci-pci: EHCI PCI platform driver
[    4.075275] megaraid_sas 0000:03:00.0: firmware supports msix	: (16)
[    4.076165] megaraid_sas 0000:03:00.0: requested/available msix 16/16
[    4.076174] megaraid_sas 0000:03:00.0: current msix/online cpus	: (16/32)
[    4.076178] megaraid_sas 0000:03:00.0: RDPQ mode	: (disabled)
[    4.076184] megaraid_sas 0000:03:00.0: Current firmware supports maximum commands: 1008	 LDIO threshold: 0
[    4.077081] megaraid_sas 0000:03:00.0: Configured max firmware commands: 1007
[    4.087103] tg3 0000:01:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:9d:f3:3e
[    4.087111] tg3 0000:01:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    4.087117] tg3 0000:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    4.087122] tg3 0000:01:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    4.096141] megaraid_sas 0000:03:00.0: Performance mode :Latency
[    4.096145] megaraid_sas 0000:03:00.0: FW supports sync cache	: No
[    4.096154] megaraid_sas 0000:03:00.0: megasas_disable_intr_fusion is called outbound_intr_mask:0x40000009
[    4.097305] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    4.097322] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    4.097344] ehci-pci 0000:00:1a.0: debug port 2
[    4.098736] ehci-pci 0000:00:1a.0: Using iommu dma mapping
[    4.098740] ehci-pci 0000:00:1a.0: DMAR: 32bit DMA uses non-identity mapping
[    4.102695] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    4.102739] ehci-pci 0000:00:1a.0: irq 23, io mem 0xdf8fe000
[    4.117719] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    4.118044] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[    4.118048] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.118051] usb usb1: Product: EHCI Host Controller
[    4.118054] usb usb1: Manufacturer: Linux 5.4.203-1-pve ehci_hcd
[    4.118056] usb usb1: SerialNumber: 0000:00:1a.0
[    4.118457] hub 1-0:1.0: USB hub found
[    4.118568] hub 1-0:1.0: 2 ports detected
[    4.119654] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    4.119663] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    4.119699] ehci-pci 0000:00:1d.0: debug port 2
[    4.120629] ehci-pci 0000:00:1d.0: Using iommu dma mapping
[    4.120631] ehci-pci 0000:00:1d.0: DMAR: 32bit DMA uses non-identity mapping
[    4.124570] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    4.124607] ehci-pci 0000:00:1d.0: irq 22, io mem 0xdf8ff000
[    4.137596] tg3 0000:01:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:9d:f3:3f
[    4.137600] tg3 0000:01:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    4.137603] tg3 0000:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    4.137606] tg3 0000:01:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    4.137718] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    4.137799] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04
[    4.137803] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.137805] usb usb2: Product: EHCI Host Controller
[    4.137808] usb usb2: Manufacturer: Linux 5.4.203-1-pve ehci_hcd
[    4.137810] usb usb2: SerialNumber: 0000:00:1d.0
[    4.138701] hub 2-0:1.0: USB hub found
[    4.138715] hub 2-0:1.0: 2 ports detected
[    4.149730] megaraid_sas 0000:03:00.0: FW provided supportMaxExtLDs: 0	max_lds: 64
[    4.149734] megaraid_sas 0000:03:00.0: controller type	: MR(512MB)
[    4.149736] megaraid_sas 0000:03:00.0: Online Controller Reset(OCR)	: Enabled
[    4.149738] megaraid_sas 0000:03:00.0: Secure JBOD support	: No
[    4.149741] megaraid_sas 0000:03:00.0: NVMe passthru support	: No
[    4.149743] megaraid_sas 0000:03:00.0: FW provided TM TaskAbort/Reset timeout	: 0 secs/0 secs
[    4.149745] megaraid_sas 0000:03:00.0: JBOD sequence map support	: No
[    4.149747] megaraid_sas 0000:03:00.0: PCI Lane Margining support	: No
[    4.169561] tg3 0000:02:00.0 eth2: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:9d:f3:40
[    4.169565] tg3 0000:02:00.0 eth2: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    4.169569] tg3 0000:02:00.0 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    4.169572] tg3 0000:02:00.0 eth2: dma_rwctrl[00000001] dma_mask[64-bit]
[    4.178224] megaraid_sas 0000:03:00.0: megasas_enable_intr_fusion is called outbound_intr_mask:0x40000000
[    4.178228] megaraid_sas 0000:03:00.0: INIT adapter done
[    4.178231] megaraid_sas 0000:03:00.0: JBOD sequence map is disabled megasas_setup_jbod_map 5743
[    4.181671] megaraid_sas 0000:03:00.0: pci id		: (0x1000)/(0x005b)/(0x1028)/(0x1f38)
[    4.181674] megaraid_sas 0000:03:00.0: unevenspan support	: no
[    4.181676] megaraid_sas 0000:03:00.0: firmware crash dump	: no
[    4.181678] megaraid_sas 0000:03:00.0: JBOD sequence map	: disabled
[    4.181982] scsi host4: Avago SAS based MegaRAID driver
[    4.199852] tg3 0000:02:00.1 eth3: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:9d:f3:41
[    4.199856] tg3 0000:02:00.1 eth3: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    4.199860] tg3 0000:02:00.1 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    4.199863] tg3 0000:02:00.1 eth3: dma_rwctrl[00000001] dma_mask[64-bit]
[    4.236368] scsi 4:2:0:0: Direct-Access     DELL     PERC H710        3.13 PQ: 0 ANSI: 5
[    4.237125] scsi 4:2:1:0: Direct-Access     DELL     PERC H710        3.13 PQ: 0 ANSI: 5
[    4.246144] tg3 0000:02:00.1 eno4: renamed from eth3
[    4.281981] tg3 0000:01:00.1 eno2: renamed from eth1
[    4.294583] sd 4:2:0:0: Attached scsi generic sg1 type 0
[    4.294609] sd 4:2:0:0: [sda] 1952448512 512-byte logical blocks: (1000 GB/931 GiB)
[    4.294647] sd 4:2:0:0: [sda] Write Protect is off
[    4.294650] sd 4:2:0:0: [sda] Mode Sense: 1f 00 00 08
[    4.294711] sd 4:2:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.295040] sd 4:2:1:0: [sdb] 487325696 512-byte logical blocks: (250 GB/232 GiB)
[    4.295047] sd 4:2:1:0: Attached scsi generic sg2 type 0
[    4.295072] sd 4:2:1:0: [sdb] Write Protect is off
[    4.295075] sd 4:2:1:0: [sdb] Mode Sense: 1f 00 00 08
[    4.295133] sd 4:2:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.334005] tg3 0000:01:00.0 eno1: renamed from eth0
[    4.336584]  sdb: sdb1 sdb2 sdb3
[    4.339106]  sda: sda1 sda2 sda3
[    4.366525] sd 4:2:1:0: [sdb] Attached SCSI disk
[    4.366540] sd 4:2:0:0: [sda] Attached SCSI disk
[    4.377744] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    4.380249] tg3 0000:02:00.0 eno3: renamed from eth2
[    4.397724] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    4.431834] random: lvm: uninitialized urandom read (4 bytes read)
[    4.514732] random: lvm: uninitialized urandom read (4 bytes read)
[    4.534379] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    4.534383] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.534957] hub 1-1:1.0: USB hub found
[    4.535115] hub 1-1:1.0: 6 ports detected
[    4.540746] random: lvm: uninitialized urandom read (2 bytes read)
[    4.554044] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    4.554049] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    4.554577] hub 2-1:1.0: USB hub found
[    4.554667] hub 2-1:1.0: 8 ports detected
[    4.821738] usb 1-1.6: new high-speed USB device number 3 using ehci-pci
[    4.931460] usb 1-1.6: New USB device found, idVendor=413c, idProduct=a001, bcdDevice= 0.00
[    4.931464] usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    4.931467] usb 1-1.6: Product: Gadget USB HUB
[    4.931470] usb 1-1.6: Manufacturer: no manufacturer
[    4.931472] usb 1-1.6: SerialNumber: 0123456789
[    4.931858] hub 1-1.6:1.0: USB hub found
[    4.932045] hub 1-1.6:1.0: 6 ports detected
[    5.321166] random: crng init done
[    5.409741] usb 1-1.6.1: new high-speed USB device number 4 using ehci-pci
[    5.543460] usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249, bcdDevice= 0.00
[    5.543472] usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
[    5.543475] usb 1-1.6.1: Product: Keyboard/Mouse Function
[    5.543482] usb 1-1.6.1: Manufacturer: Avocent
[    5.543484] usb 1-1.6.1: SerialNumber: 20121018
[    5.548034] hidraw: raw HID events driver (C) Jiri Kosina
[    5.551810] usbcore: registered new interface driver usbhid
[    5.551813] usbhid: USB HID core driver
[    5.552724] usbcore: registered new interface driver usbkbd
[    5.552758] usbcore: registered new interface driver usbmouse
[    5.555103] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0001/input/input1
[    5.612471] device-mapper: thin: Data device (dm-3) discard unsupported: Disabling discard passdown.
[    5.613967] hid-generic 0003:0624:0249.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
[    5.614224] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.0002/input/input2
[    5.614502] hid-generic 0003:0624:0249.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
[    5.614737] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.0003/input/input3
[    5.615050] hid-generic 0003:0624:0249.0003: input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
[    7.124430] device-mapper: thin: Data device (dm-12) discard unsupported: Disabling discard passdown.
[    7.501718] raid6: sse2x4   gen()  4930 MB/s
[    7.549711] raid6: sse2x4   xor()  3307 MB/s
[    7.597712] raid6: sse2x2   gen()  4192 MB/s
[    7.645702] raid6: sse2x2   xor()  2815 MB/s
[    7.693716] raid6: sse2x1   gen()  3511 MB/s
[    7.741710] raid6: sse2x1   xor()  2528 MB/s
[    7.741712] raid6: using algorithm sse2x4 gen() 4930 MB/s
[    7.741720] raid6: .... xor() 3307 MB/s, rmw enabled
[    7.741722] raid6: using ssse3x2 recovery algorithm
[    7.743914] xor: automatically using best checksumming function   avx       
[    7.763877] Btrfs loaded, crc32c=crc32c-intel
[    8.048647] EXT4-fs (dm-1): mounted filesystem with ordered data mode. Opts: (null)
[    8.235640] systemd[1]: Failed to look up module alias 'autofs4': Function not implemented
[    8.248848] cgroup2: Unknown parameter 'memory_recursiveprot'
[    8.249432] ERST: NVRAM ERST Log Address Range not implemented yet.
[    8.252064] systemd[1]: systemd 247.3-7+1-pmx11u1 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +ZSTD +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=unified)
[    8.269962] systemd[1]: Detected architecture x86-64.
[    8.270553] systemd[1]: Set hostname to <beast>.
[    8.517921] systemd[1]: Queued start job for default target Graphical Interface.
[    8.537207] systemd[1]: Created slice system-getty.slice.
[    8.538361] systemd[1]: Created slice system-modprobe.slice.
[    8.539555] systemd[1]: Created slice system-postfix.slice.
[    8.540598] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[    8.541514] systemd[1]: Created slice User and Session Slice.
[    8.541678] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    8.541833] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    8.541964] systemd[1]: Starting of Arbitrary Executable File Formats File System Automount Point not supported.
[    8.542678] systemd[1]: Reached target ceph target allowing to start/stop all [email protected] instances at once.
[    8.542713] systemd[1]: Reached target ceph target allowing to start/stop all ceph*@.service instances at once.
[    8.542741] systemd[1]: Reached target Local Encrypted Volumes.
[    8.542847] systemd[1]: Reached target Paths.
[    8.542919] systemd[1]: Reached target Slices.
[    8.542980] systemd[1]: Reached target System Time Set.
[    8.543201] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[    8.543463] systemd[1]: Listening on LVM2 poll daemon socket.
[    8.551143] systemd[1]: Listening on RPCbind Server Activation Socket.
[    8.551561] systemd[1]: Listening on Syslog Socket.
[    8.551830] systemd[1]: Listening on fsck to fsckd communication Socket.
[    8.552012] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    8.552424] systemd[1]: Listening on Journal Audit Socket.
[    8.552669] systemd[1]: Listening on Journal Socket (/dev/log).
[    8.552967] systemd[1]: Listening on Journal Socket.
[    8.553963] systemd[1]: Listening on udev Control Socket.
[    8.554233] systemd[1]: Listening on udev Kernel Socket.
[    8.556504] systemd[1]: Mounting Huge Pages File System...
[    8.558840] systemd[1]: Mounting POSIX Message Queue File System...
[    8.561258] systemd[1]: Mounting RPC Pipe File System...
[    8.563534] systemd[1]: Mounting Kernel Debug File System...
[    8.565747] systemd[1]: Mounting Kernel Trace File System...
[    8.565920] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped.
[    8.568198] systemd[1]: Starting Set the console keyboard layout...
[    8.568304] systemd[1]: Condition check resulted in Create list of static device nodes for the current kernel being skipped.
[    8.570441] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
[    8.572452] systemd[1]: Starting Load Kernel Module configfs...
[    8.574397] systemd[1]: Starting Load Kernel Module drm...
[    8.576311] systemd[1]: Starting Load Kernel Module fuse...
[    8.577405] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[    8.577515] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[    8.582338] systemd[1]: Starting Journal Service...
[    8.585599] systemd[1]: Starting Load Kernel Modules...
[    8.587973] systemd[1]: Starting Remount Root and Kernel File Systems...
[    8.590285] systemd[1]: Starting Coldplug All udev Devices...
[    8.594631] systemd[1]: Mounted Huge Pages File System.
[    8.594944] systemd[1]: Mounted POSIX Message Queue File System.
[    8.595227] systemd[1]: run-rpc_pipefs.mount: Mount process exited, code=exited, status=32/n/a
[    8.595238] systemd[1]: run-rpc_pipefs.mount: Failed with result 'exit-code'.
[    8.595887] systemd[1]: Failed to mount RPC Pipe File System.
[    8.596633] systemd[1]: Dependency failed for RPC security service for NFS client and server.
[    8.597253] systemd[1]: rpc-gssd.service: Job rpc-gssd.service/start failed with result 'dependency'.
[    8.597270] systemd[1]: Dependency failed for RPC security service for NFS server.
[    8.597968] systemd[1]: rpc-svcgssd.service: Job rpc-svcgssd.service/start failed with result 'dependency'.
[    8.598402] systemd[1]: Mounted Kernel Debug File System.
[    8.598733] systemd[1]: Mounted Kernel Trace File System.
[    8.599577] systemd[1]: Finished Set the console keyboard layout.
[    8.600328] systemd[1]: [email protected]: Succeeded.
[    8.600842] systemd[1]: Finished Load Kernel Module configfs.
[    8.601572] systemd[1]: [email protected]: Succeeded.
[    8.602050] systemd[1]: Finished Load Kernel Module drm.
[    8.602699] systemd[1]: [email protected]: Succeeded.
[    8.603187] systemd[1]: Finished Load Kernel Module fuse.
[    8.603550] systemd[1]: systemd-modules-load.service: Main process exited, code=exited, status=1/FAILURE
[    8.603862] systemd[1]: systemd-modules-load.service: Failed with result 'exit-code'.
[    8.604435] systemd[1]: Failed to start Load Kernel Modules.
[    8.605269] EXT4-fs (dm-1): re-mounted. Opts: errors=remount-ro
[    8.608006] systemd[1]: Finished Remount Root and Kernel File Systems.
[    8.608392] systemd[1]: Reached target NFS client services.
[    8.611406] systemd[1]: Mounting FUSE Control File System...
[    8.613662] systemd[1]: Mounting Kernel Configuration File System...
[    8.614697] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[    8.614869] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[    8.616951] systemd[1]: Starting Load/Save Random Seed...
[    8.619274] systemd[1]: Starting Apply Kernel Variables...
[    8.621562] systemd[1]: Starting Create System Users...
[    8.623842] systemd[1]: Mounted FUSE Control File System.
[    8.624184] systemd[1]: Mounted Kernel Configuration File System.
[    8.628768] systemd[1]: Started Device-mapper event daemon.
[    8.636290] systemd[1]: Finished Load/Save Random Seed.
[    8.637384] systemd[1]: Finished Apply Kernel Variables.
[    8.637899] systemd[1]: Condition check resulted in First Boot Complete being skipped.
[    8.645521] systemd[1]: Finished Create System Users.
[    8.647836] systemd[1]: Starting Create Static Device Nodes in /dev...
[    8.671151] systemd[1]: Finished Create Static Device Nodes in /dev.
[    8.675680] systemd[1]: Starting Rule-based Manager for Device Events and Files...
[    8.729500] systemd[1]: Started Rule-based Manager for Device Events and Files.
[    8.797427] systemd[1]: Finished Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
[    8.797768] systemd[1]: Reached target Local File Systems (Pre).
[    8.866863] systemd[1]: Finished Coldplug All udev Devices.
[    8.871342] systemd[1]: Starting Helper to synchronize boot up for ifupdown...
[    8.874890] systemd[1]: Starting Wait for udev To Complete Device Initialization...
[    9.011270] systemd[1]: Started Journal Service.
[    9.182251] systemd-journald[690]: Received client request to flush runtime journal.
[    9.205723] Adding 4194300k swap on /dev/mapper/pve-swap.  Priority:-2 extents:1 across:4194300k FS
[    9.372939] audit: type=1400 audit(1684658287.974:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/lxc-start" pid=910 comm="apparmor_parser"
[    9.373033] audit: type=1400 audit(1684658287.974:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="swtpm" pid=913 comm="apparmor_parser"
[    9.373408] audit: type=1400 audit(1684658287.974:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=909 comm="apparmor_parser"
[    9.374394] audit: type=1400 audit(1684658287.978:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=906 comm="apparmor_parser"
[    9.374401] audit: type=1400 audit(1684658287.978:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=906 comm="apparmor_parser"
[    9.374902] audit: type=1400 audit(1684658287.978:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=908 comm="apparmor_parser"
[    9.374919] audit: type=1400 audit(1684658287.978:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=908 comm="apparmor_parser"
[    9.374924] audit: type=1400 audit(1684658287.978:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=908 comm="apparmor_parser"
[    9.376245] audit: type=1400 audit(1684658287.978:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/chronyd" pid=911 comm="apparmor_parser"
[    9.443268] proc: Bad value for 'hidepid'
[   10.236096] vmbr0: port 1(eno1) entered blocking state
[   10.236101] vmbr0: port 1(eno1) entered disabled state
[   10.236252] device eno1 entered promiscuous mode
[   14.022099] tg3 0000:01:00.0 eno1: Link is up at 1000 Mbps, full duplex
[   14.022124] tg3 0000:01:00.0 eno1: Flow control is on for TX and on for RX
[   14.022130] tg3 0000:01:00.0 eno1: EEE is enabled
[   14.022178] vmbr0: port 1(eno1) entered blocking state
[   14.022183] vmbr0: port 1(eno1) entered forwarding state
[   14.022289] IPv6: ADDRCONF(NETDEV_CHANGE): vmbr0: link becomes ready
[   41.345442] device tap109i0 entered promiscuous mode
[  302.339569] device tap109i0 entered promiscuous mode
[  380.238262] device tap109i0 entered promiscuous mode

Maybe I messed up a grub setting or forgot something else… don’t really like this or some of the other systemd errors before it:

[ 8.604435] systemd[1]: Failed to start Load Kernel Modules.

This is the kind of thing I expect to see with an upgrade, not a new install.

I may continue this thread over at the Proxmox forums, but I think I really shoulda taken that drive out as originally planned… lol

I believe somehow the new install is booting with the OLD kernel version, so all kernel modules are failing to load. Still not sure why that would happen but maybe leaving the old version accessible caused things to get mixed up at some point.

Proxmox VE 6.4 uses Linux kernel 5.4, while Proxmox VE 7.4 uses Linux kernel 5.15*

# uname -r
5.15.107-2-pve

^ Ok, seems good.

# dmesg
[    0.000000] Linux version 5.4.203-1-pve (build@proxmox) (gcc version 8.3.0 (Debian 8.3.0-6)) #1 SMP PVE 5.4.203-1 (Fri, 26 Aug 2022 14:43:35 +0200) ()

^Huh

I’m going froom Proxmox 6.4 to 7.4 but in this supposed 7.4 install it looks to me that systemd is seeing a kernel version for 6.4. What the heck…?

Maybe there’s an easy fix (rebuilding that initrd stuff? edit - Meant “initramfs”
I think
) but I’m not familiar enough with LInux bootstrapping to know for sure… doing some more research, maybe a brand new single drive reinstall would be better.


*Fun fact, that quote is part of the output from a supposed “AI” named Perplexity which answered the question of Proxmox kernel versions much faster than the usual search engine stuff could.

Was going to reinstall, so I pulled the old drive, and I’m sure I rebooted at some point.

Now the dmesg errors are gone and the reported kernel in systemd is correct.
Everything is working now as far as I can tell.

What the heck happened here?

Your system could easily be confused, booting-off of one drive while mounting the partitions from the other drive. Using UUID (in /etc/fstab and grub) can help prevent this. Or you can boot-up with the secondary drive removed, and only connect it after the system has booted.

Oh well, lesson learned, next time I’ll just pull the drive if I do a similar upgrade. Shockingly the VMs I migrated work fine, including even the PCIe Quadro that’s passed through to a crummy Windoze VM.

This is probs super late but I wanted to leave a note here. I just had a dell server I was using as a NAS explode. When I was seting it up though, it was way more helpful to be at the console, and have a laptop jacked into idrac over a crossover cable. Saved me a TON of time.

Yeah idrac is pretty awesome, almost makes up for the fact that this is a loud boat anchor that has to be isolated in the home “data center”. :stuck_out_tongue:

That’s good to know, I have a 630 that hums a soothing melody in the corner, even under load.

1 Like