I’ll throw my system here for your amusement:
-A 2200 Watt asus workstation psu (bought it simply because it had 4 VHPWR slots)
-AM4 X570 D4U 2L-2T/BCM motherboard
-5950X 16C/32T
-128GB of DDR4
-A passive pcie to mcio card hooked up to a PLX88096 Aliexpress special
-Quad R9700’s via sff-8654 8i to mcio cables to a mcio adapter
-2 4TB samsung pcie 4.0 nvme’s
-8-bay but only 6 slots filled with 2TB samsung 870 evo drives in raid-z1
-P2P working inside the VM (with a few minor caveats see P2P enablement on prosumer AM4 with Quad AMD R9700's....on a proxmox VM with a PLX switch )
currently serving an mxfp4 optimised version of qwen flash-next on vLLM with 1M total context cache and a C8 of 300 tk/s and a C1 at 80 tk/s