Asrock X570d4u, x570d4u-2L2T discussion thread

Hardware Hub Motherboards
, ,
954

Hi L1F, first post here.
I recently built a Proxmox PVE server for myself using the X570D4U-2L2T and this thread was helpful while I was researching so I figured I’d join and contribute to the knowledge pool.

One thing I had trouble with was finding memory, seems like most (all?) of the RAM on the QVL is unavailable now so fwiw I ended up going with four 32GB sticks of Samsung M391A4G43AB1-CWE ECC (paired with a 5950x).
Systems had about a month of uptime now and it’s been stable but I haven’t done any testing or benchmarking, so if anyone has any suggestions let me know and I’ll give it a shot.

1 Like
955

I’ve been using non-qvl memory since I set up my board. It was just 16gb (2x 8) of ripjaws 3200. Since I’ve been rebuilding it, I was looking at swapping RAM but the 3200 on the QVL has just awful timings. I am going to put 64gb of ripjaws 3200 in and hope for the best. I’m using pcie passthrough now and my understanding is that I now have to dedicate memory to that VM in proxmox.

956

So my RIPJAWS 5 64GB kit worked. Also installed my Tesla P4 at the time. Didn’t want to boot, Didn’t want to boot…and then I realized I was the problem. Cleared CMOS and bang, no issues.

Proxmox is reporting it running at 2666 in CLI. In BIOS it is running auto but I probably need to manually set it to 3200m/t. Once that is sorted I may see what happens when I stick the 2x8GB back in slot two for both channels.

lspci is also reporting both my HBA and P4 so I guess auto bifurcation worked too.

1 Like
957

Hi everyone!

I’ve been messing around with this board (X570D4U-2L2T) for a while now and I’ve run into a strange issue that I’m reasonably sure is a BIOS bug, and I’m a bit stumped on how to get any further.

I’m planning to use this board to build a li’l home server that’ll mostly be a virtualisation host. One of the VMs is going to act as our home router, running OpenWRT. I’m able to passthrough the two I210 NICs, and a VF of each of the X550s (leaving the PF on the host) without issue, and ACS seems to be working fine, given the board’s IOMMU groups seem to be what I’d expect.

Where I run into issues is trying to assign my wireless adapter (QNAP QWA-AC2600). This card’s a little weird in that it has two entirely independent QCA9984 wireless interfaces (in separate IOMMU groups) behind an ASM1182e PCIe switch (which is in a third independent IOMMU group). If I assign just one of the two QCA9984s to the VM, everything works just fine. Similarly, if I attach the second QCA9984 to the same VM at runtime, it initialises in the guest without issue and all is well. Likewise, both cards work just fine on the host. For reference, this is how it shows up in lspci (on the host):

29:00.0 PCI bridge: ASMedia Technology Inc. ASM1182e 2-Port PCIe x1 Gen2 Packet Switch
2a:03.0 PCI bridge: ASMedia Technology Inc. ASM1182e 2-Port PCIe x1 Gen2 Packet Switch
2a:07.0 PCI bridge: ASMedia Technology Inc. ASM1182e 2-Port PCIe x1 Gen2 Packet Switch
2b:00.0 Network controller: Qualcomm Atheros QCA9984 802.11ac Wave 2 Wireless Network Adapter
2c:00.0 Network controller: Qualcomm Atheros QCA9984 802.11ac Wave 2 Wireless Network Adapter

However, I run into issues if both QCA9984s are attached to the VM (i.e. defined in the domain XML) when the VM is initially booted, or when it exits. In either case, the entire physical card (i.e. both wireless NICs and the PCIe switch on the card) seem to fall off the bus and end up in an unusable state until the host is rebooted (removing them and triggering a bus rescan does not bring them back), with the following dmesg output:

Jun 01 13:33:39 safi-server kernel: pcieport 0000:2a:03.0: Unable to change power state from D0 to D3hot, device inaccessible
Jun 01 13:33:39 safi-server kernel: pcieport 0000:2a:07.0: Unable to change power state from D0 to D3hot, device inaccessible
Jun 01 13:33:39 safi-server kernel: pcieport 0000:29:00.0: Unable to change power state from D0 to D3hot, device inaccessible
Jun 01 13:33:39 safi-server kernel: pcieport 0000:29:00.0: Unable to change power state from D3cold to D0, device inaccessible
Jun 01 13:33:39 safi-server kernel: pcieport 0000:2a:03.0: Unable to change power state from D3cold to D0, device inaccessible
Jun 01 13:33:39 safi-server kernel: pcieport 0000:2a:07.0: Unable to change power state from D3cold to D0, device inaccessible

This happens immediately upon trying to boot the domain (or when it exits, if the second card was attached to it at runtime), long before the guest kernel is started (I don’t think it even makes it to OVMF - I’m pretty sure qemu fails to actually start), so I don’t think it has anything to do with the guest OS.

I’ve also tested this selfsame wifi card on a different motherboard and this issue does not occur there, suggesting that it is not an issue to do with the wifi card itself.

Likewise, I’ve also tested on the X570D4U-2L2T itself with both my actual OS & kernel, and the same test environment I used on the other board (a standard Ubuntu live environment) and the issue occurs identically with both, seeming to rule out an issue specific to my kernel / userspace configuration.

At this stage it seems quite likely to be some sort of bug with the board’s BIOS (I’m running version 1.78 - 1.70 had issues running my RAM at 3200MHz, whereas 1.40 threw occasional MCEs and had spontaneous resets - the 1.78 BIOS hasn’t had either of these issues), but I’m at a loss for how to proceed. It could well simply be a configuration issue in my board’s BIOS, but I’m not sure what I’d be looking for exactly.

958

@KeithMyers and @aBav.Normie-Pleb : seeing your interest in the coreboot opensource BIOS firmware, I feel obliged to invite you both to our opensource firmware online party :blush: More info here - DUG#6 & vPub 0xB opensource online Party! - tomorrow at 4 PM UTC

1 Like
959

i had this issue before and shoot me quite a while and swapping PSU solves it. you should check bmc to see if the voltage of 12/5/3.3v is low since this board require a stable PSU and does not really allow undervolt on those rail. just get a expansive and big brand psu e.g. seasonic.

also this board cant really handle high speed ram when all 4 dimm slot utilized. if you try to you eventually see bios post 01 stuck or mce error on memory. mine has 32G*4 2933mhz bearly stable with ecc memory with occasionally mce recover log. if you have non-ecc ram just stick with 2666mhz will save your time (see asrock mb docs. tech spec max ram spd).

960

Hello,

I have got a X570D4U running with a Ryzen 5950X. It seems to be impossible to get 4*32 GB ECC RAM working at 3200 MT/s stable. I am using Micron 32 GB ECC DDR4 3200 E-Die sticks.
UEFI 1.50 and 1.57 won’t post with 4 slots populated as soon as RAM speed is set manually. With UEFI 1.20 I don’t get stable settings with 3200 MT/s.

Are there any users who are running 4 * 32 GB ECC at 3200 MT/s without errors?

961

I had to slowly back off the timings of my 4*32 GB ECC (approved modules) setup until it was stable. 3200 would post, but I would get random crashes. I don’t know what I’m currently at now, but I haven’t had any issues.

962

Hello,

After testing I have found out that the two chokes near the B1 DIMM-Slot get very hot when 4 DIMMS are under stress. They heat up the DIMM’s ICs up to 100°C which contributes to instabilities. With a small fan I could keep them under 70°C.

Another issue is the signal quality of the board. When manually setting ProcODT to 43,6 ohm CAD data bus to 7,3,1 and CAD drive strength to 30, 24, 30, 24 it is almost stable under full stress for 24 hours.

The DIMMs I have been using are Micron 32 GB ECC 3200 MTA18ASF4G72AZ-3G2B1R.

All in all it seems like ASRock has been on the cheep side when designing the board. As a comparison the chokes on an ASRock B550M Steel Legend stay pretty cool and don’t heat up the DIMMs.

963

Odd, my PSU definitely shouldn’t be an issue, if anything it’s overkill (Corsair AX1600i). I don’t have any issues with memory - it’s running 4*32GB ECC (Kingston KSM32ED8/32HC) at 3200MHz stable (It’s been up for a few months now with no MCEs) on the L1.78 bios.

The only issue I seem to be having is weird PCIe reset with the wifi card (which doesn’t happen on a different board, so it’s definitely something specific to this board).

1 Like
964

@Exard3k did the ASUS Hyper M.2 Card work out of the box? I have a X570D4U in front of me and it will only recognize the slots 1+2 on the card. Slots 3+4 won’t show up neither in BIOS, nor in Windows, nor in Proxmox. I enabled 4x4x4x4 but I think I am missing something…

EDIT: it’s right there in the manual. The upper PCIe automatically switches to x8 when something is connected to the lowest slot. In my case it was just a riser adapter, so I did not think about much. Just unplugging it switched the slot back to x16 and made the other 2 m.2 slots visible.

1 Like
965

Sorry, I’m late as I’m not so active on the foruims atm.

Yeah, that “BIOS bifurcation” on top of the hardware switch when plugging in a card in the second slot really gets most people. It’s damn confusing, but makes sense and is a good thing if you want options and I like it because of that.

Glad you solved it in the meantime. Most people here either have incompatible/slow running RAM or questions about the x8/x8 switch and bifurcation, so that’s only normal :slight_smile:

1 Like
966

I’ve got the X570D4U without 10Gb as it was the only I could find available here. I’ve got my x550-T2 and HBA in the two PCIE slots, all working fine. I would like to add in my Arc A310 for transcoding but then I need to remove the X550. I would like to retain 10Gb has anyone experience of using one of those 10Gb m.2 nic on this board? Running it with truenas scale.

967

Anyone else not seeing sensor values / graph values being refreshed in the web UI? Regardless of browser and browser settings/extensions, it doesn’t work. Also, it’s saying there are a number of fan and temp events (doing some maintenance) but when I click into it, it says 0 events. Is my IPMI broken? Can I reflash this?