Hello All,
I am currently building a multipurpose computer based on the Asrock LiveMixer Z790. The computer is going to replace a NAS, two gaming machines, and a laptop acting as a docker server.
To achieve this I am testing TrueNAS Scale and Proxmox. The build is equipped with an Intel i7-13700. 13th Gen Intel is very new and based on my research I should be running a 6.0 or newer kernel to have support. Therefore I am leaning towards Proxmox as the main hypervisor for the build.
The Hardware
Motherboard: Asrock LiveMixer Z790 (BIOS version 7.04) Specs Sheet
CPU: Intel 13th Gen Core i7-13700 Specs Sheet
RAM: G.Skill 64GB DDR5-6000 Specs Sheet
SSD: 2x 2TB Samsung 980 Pro (See Storage Configuration - Flash) Specs Sheet
SSD: 2x 256GB Micron (See Storage Configuration - Rust)
HDD: 3x 8TB Seagate Barracuda (See Storage Configuration - Rust) Specs Sheet
PCIe: LSI SAS2308-8i HBA Controller (Flashed into IT Mode)
BIOS Settings - Chipset Configuration
- SRV-IOV Support - Enabled (see vGPU)
- VT-D - Enabled
- Above 4G Decoding - Enabled
- C.A.M - Enabled
- PCI Express Native Control - Enabled
- PCIE ASPM Support - Disabled
- PCH PCIE ASPM Support - Disabled
- DMI ASPM Support - Disabled
- PCh DMI ASPM Support - Disabled
Hardware Issues - GPU Passthrough
The plan I had in mind was to pass through a AMD RX5700 XT to a Windows VM with Hyper-V Features. On the Hyper-V VM I would have leveraged GPU-P to further divide into two other Windows VMs.
I have tried every guide I could find online regarding PCIe/GPU Passthrough for Proxmox and I have always run into Error 43 on the VM. I am not sure where the issue lies as 13th Gen support is very new or AMD GPU being… an AMD GPU.
My current plan is to buy a RTX 2080 Ti and follow the guide below. In the future i’ll keep an eye open for a Quadro RTX once those prices come down enough.
**Current Proxmox **
Proxmox 7.4-4 (kernel 6.2.9-1-pve)
CPU Microcode v2.2 (dated 2023-02-06) (used helper script from: here)
Configuration (so far)
I’ve configured i915 with SR-IOV support. See my post.
/etc/modules
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd
/etc/default/grub
GRUB_CMDLINE_LINUX_DEFAULT=“quiet intel_iommu=on i915.enable_guc=3 i915.max_vfs=7 net.ifnames=0 biosdevname=0”
Storage Configuration
Flash
The Samsung 980s support 512-byte sectors and are formatted properly by Proxmox. Confirmed with smartctl. (instructions) They are in a mirrored configuration with compression turned off.These are the scores I got using a Windows 11 VM running on the ZFS pool.
Rust
I’m currently waiting on a cable for my HBA Controller…
RGB Controls
Installed OpenRGB on Proxmox. I tried to run this inside an LXC container intially with no success. This guide was helpful.
/etc/systemd/system/openrgb.service
[Unit]
Description=OpenRGB server
After=network.target
[Service]
ExecStart=/usr/bin/openrgb --server
Type=simple
Restart=always
RestartSec=3
[Install]
WantedBy=multi-user.target
With OpenRGB, I can now control all the RGB using the client on a Windows VM.
I’d appreciate any feedback and tips!
Cheers!