ASRock Rack has created the first AM4 socket server boards, X470D4U, X470D4U2-2T

Hardware Motherboards
, ,
1214

There was an issue with IPMI failing to respond until power cycling:

AFAIK it was fixed in one of the BMC versions and since you are running the latest 1.90 I guess this should no longer happen.

@nx2l @Waishon
Can you confirm if this was fixed?

That is correct. -U is username and -P is password - using credentials you have set should work. You can also do not provide -P - it should prompt you for password separately

Also:

Those are a part of lan print log. So i guess it worked, it just seems like itā€™s the lan could be disabled?

For me the lan print shows something like this right now:

Set in Progress : Set Complete
Auth Type Support : MD5
Auth Type Enable : Callback : MD5
: User : MD5
: Operator : MD5
: Admin : MD5
: OEM : MD5
IP Address Source : DHCP Address
IP Address : 192.168.1.168
Subnet Mask : 255.255.255.0
MAC Address : d0:50:99:e3:44:d9
SNMP Community String : AMI
IP Header : TTL=0x40 Flags=0x40 Precedence=0x00 TOS=0x10
BMC ARP Control : ARP Responses Enabled, Gratuitous ARP Disabled
Gratituous ARP Intrvl : 0.0 seconds
Default Gateway IP : 192.168.1.1
Default Gateway MAC : 00:26:55:e3:05:c1
Backup Gateway IP : 0.0.0.0
Backup Gateway MAC : 00:00:00:00:00:00
802.1q VLAN ID : Disabled
802.1q VLAN Priority : 0
RMCP+ Cipher Suites : 0,1,2,3,6,7,8,11,12,15,16,17
Cipher Suite Priv Max : caaaaaaaaaaaXXX
: X=Cipher Suite Unused
: c=CALLBACK
: u=USER
: o=OPERATOR
: a=ADMIN
: O=OEM
Bad Password Threshold : 0
Invalid password disable: no
Attempt Count Reset Int.: 0
User Lockout Interval : 0

You could try checking if you can at least list available commands.
If the login worked then this should do it:
ipmitool -U admin -P admin help

1215

Not sure if this is the same as what Iā€™m getting. Power cycling alone doesnā€™t fixing, I need to remove the NIC and boot the BMC without it.

Seems so, it would explain why it wasnā€™t showing up in my network. Pretty wierd that adding a pcie card disables the BMC port.

1216

I tried deactivating lan access on my board and after I doing so the printed information didnā€™t break like in your case.

You could try reactivating lan with:
ipmitool -U admin -P admin lan set 1 access on
But I doubt it will help. Itā€™s probably a bug in the BMC :\

Could you tell me what NIC did you use and which PCIe slot you plugged it into?

Also: while you canā€™t access lan information can you use other IPMI features? like checking power status:
ipmitool -U admin -P admin chassis status
or get event logs:
ipmitool -U admin -P admin sel list

1217

I used an Intel I350-T4, by Dell I think, in the bottom slot. I changed the lanes to 2x8 in the bios to get it to work.
Yes, the other IPMI features work, I can see logs etc.

1218

I have noticed that if i unplug the ipmi portā€¦ the port will not work again (using static IP no not dhcp related) until the machine is powered down and back on.
Maybe I should change the bondā€¦ idk

1219

Oh, So itā€™s possible to change the bond settings?
Iā€™ve seen it in this post:

but I never managed to get the ā€˜Network Bond Configurationā€™ option to show up. I tried flashing all available BMC versions with no effect.
Dunno. Maybe itā€™s a BMC/BIOS comboā€¦

Anyway, @Ujin Check if you can modify the bond setting before plugging in the additional NIC. Maybe it will make a difference.

1220

Soā€¦ I have the X470D4U2-2T and I have added a Noctua NH-U12S SE-AM4 tower cooler for my case.

IMG_20200714_102944
IMG_20200714_1029444032Ɨ3024 4.63 MB
IMG_20200714_103002
IMG_20200714_1030024032Ɨ3024 4.9 MB
!

As you can see, a rear exhaust mounting means that 2 heatpipes touch the top corner of RAM sticks put in the first slot. I wouldnā€™t recommend thisā€¦

IMG_20200714_103348|412x550

As you can see, trying to orient the cooler so it exhausts out the top is not possible unless you want to give up using the 4th RAM slot entirely.
But since you cant use it in the other direction with this cooler, you do you.
Yes, I know that you donā€™t put the RAM in these slots, its just for the pictures.

Edit: Iā€™m not sure why the third picture wont show up. It just shows how the mounting bracket touches the RAM stick in the closest slot if you donā€™t want to download it to see.
Edit 2: The RAM is from the QVL, the Kingston 16GB ECC UDIMMs (KSM26ED8/16ME)

2 Likes
1221

Hope that you wonā€™t share this fate: The one X470D4U model where I noticed this issue died a short while later by continuously corrupting BMC flash chip (multiple ones). Got it replaced via RMA through the retailer where I had gotten the motherboard.

1222

Now you got me worried. But with new-found motivation I dug a little and it seems like the bond setting is just invisible:

Screenshot_2020-07-14_21-48-01
Screenshot_2020-07-14_21-48-011680Ɨ898 195 KB

After editing the page source it shows up:

Screenshot_2020-07-14_21-48-16
Screenshot_2020-07-14_21-48-161683Ɨ896 210 KB

And I can normally use it and disable the bonding. After that I have eth0/1 in the IP settings. so it seems like itā€™s working.
But this is definitely weird. I reverted to previous settings and will contact Asrock about thisā€¦

1 Like
1223

Can anyone with x470d4u2-2t and 3950x try and install win7?

1224

Very interested to see how they respond to that, i was looking to disable bonding and was a little annoyed the option was missing for me as well.

Anyways, i thought i might document my experiences with the X470D4U and maybe get some input.

Started off with the hardware:
X470D4U
AMD R5 3600
64gb ddr4 of crucial CT16G4DFD8266.C16FD1 from QVL
AQN-107 10Gbe NIC
LSI 9211-8i, in IT mode
2x nvme m.2 1tb drives

Right off the bat i had some interesting issues with instability with the IPMI/BMC controller, where the board would not boot and the BMC would lock up and freeze and become unresponsive (in some cases it would reset itself 45 seconds later but not often)
Only boot device being attempted to be used is either a memtest86 usb or the unraid usb.

With a whole lot of debugging and testing i could always reproduce these failures generally by having the remote control KVM window open while the system attempts to boot/reboot.

Contacted asrock rack support and managed to go through various fix attempts and debug attempts with no effect, i was sent a replacement BMC flash chip to test if it was a corruption issue, and it did not resolve the problem, i even sent in the board for them to investigate and try and reproduce the issue to no avail.

I can only hazard a guess there is some instability with usb devices and the BMC during booting if you interact with/use the KVM features at the same time.

Decided to mostly give up on the issue and work around it by ignoring it. and everything has been working generally 100% stable with great performance and minimal power consumption.

ā€¦

Months without issue then comes one day where unraid has pretty much hard locked and only partially responsive, i was unable to get the unraid system to unmount the array and drives and was forced to power cycle the system manually.

There was a series of various errors in the dmesg output; such as some PCI-E errors Like:

[1100211.258510] pcieport 0000:00:01.1: AER: Corrected error received: 0000:01:00.0
[1100211.258516] atlantic 0000:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[1100211.258518] atlantic 0000:01:00.0:   device [1d6a:07b1] error status/mask=00000001/0000a000
[1100211.258519] atlantic 0000:01:00.0:    [ 0] RxErr                  (First)
[1302904.252985] pcieport 0000:00:01.1: AER: Multiple Corrected error received: 0000:01:00.0
[1302904.252993] pcieport 0000:00:01.1: PCIe Bus Error: severity=Corrected, type=Data Link Layer, (Transmitter ID)
[1302904.252995] pcieport 0000:00:01.1:   device [1022:1483] error status/mask=00001000/00006000
[1302904.252997] pcieport 0000:00:01.1:    [12] Timeout               
[1302904.253000] atlantic 0000:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Transmitter ID)
[1302904.253002] atlantic 0000:01:00.0:   device [1d6a:07b1] error status/mask=000010c1/0000a000
[1302904.253003] atlantic 0000:01:00.0:    [ 0] RxErr                  (First)
[1302904.253005] atlantic 0000:01:00.0:    [ 6] BadTLP                
[1302904.253006] atlantic 0000:01:00.0:    [ 7] BadDLLP               
[1302904.253007] atlantic 0000:01:00.0:    [12] Timeout               
[1302904.253008] atlantic 0000:01:00.0:   Error of this Agent is reported first
[1342611.911300] pcieport 0000:00:01.1: AER: Corrected error received: 0000:01:00.0
[1342611.911307] atlantic 0000:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[1342611.911308] atlantic 0000:01:00.0:   device [1d6a:07b1] error status/mask=00000001/0000a000
[1342611.911310] atlantic 0000:01:00.0:    [ 0] RxErr                  (First)
[1431745.380984] pcieport 0000:00:01.1: AER: Multiple Corrected error received: 0000:01:00.0
[1431745.380992] atlantic 0000:01:00.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[1431745.380994] atlantic 0000:01:00.0:   device [1d6a:07b1] error status/mask=00000041/0000a000
[1431745.380995] atlantic 0000:01:00.0:    [ 0] RxErr                  (First)
[1431745.380996] atlantic 0000:01:00.0:    [ 6] BadTLP

Which points to the AQN-107 NIC, these are similar pci-e errors as seen by the user @nx2l

and at the end of a dmesg output a btrfs error:

[1578930.466121] ------------[ cut here ]------------
[1578930.470635] kernel BUG at fs/btrfs/ctree.c:3242!
[1578930.475125] invalid opcode: 0000 [#2] SMP NOPTI
[1578930.479513] CPU: 11 PID: 30752 Comm: kworker/u64:7 Tainted: G      D W  O      4.19.107-Unraid #1
[1578930.484007] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./X470D4U, BIOS P3.30 11/04/2019
[1578930.488543] Workqueue: btrfs-endio-write btrfs_endio_write_helper
[1578930.493064] RIP: 0010:btrfs_set_item_key_safe+0xc0/0x136
[1578930.497604] Code: 00 4c 89 ef 48 8d 74 24 07 48 63 d2 48 6b d2 19 48 83 c2 65 e8 81 17 04 00 48 89 de 48 8d 7c 24 07 e8 95 f4 ff ff 85 c0 7f 02 <0f> 0b 48 8b 43 09 49 63 d4 b9 11 00 00 00 4c 89 ef 48 6b d2 19 48
[1578930.507253] RSP: 0018:ffffc9001b68bbc0 EFLAGS: 00010246
[1578930.512121] RAX: 0000000000000000 RBX: ffffc9001b68bca5 RCX: 000000000000006c
[1578930.517071] RDX: 0000000000000000 RSI: ffffc9001b68bca5 RDI: ffffc9001b68bb9f
[1578930.522017] RBP: ffff8884c44202a0 R08: 0000000000001000 R09: 0000160000000000
[1578930.527045] R10: ffff888000000000 R11: 0000000000000000 R12: 000000000000005a
[1578930.532082] R13: ffff888646607810 R14: 0000000000002d29 R15: ffff888f816bb800
[1578930.537128] FS:  0000000000000000(0000) GS:ffff888fce8c0000(0000) knlGS:0000000000000000
[1578930.542302] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1578930.547485] CR2: 0000000002f65000 CR3: 00000003abc7a000 CR4: 0000000000340ee0
[1578930.552733] Call Trace:
[1578930.557975]  __btrfs_drop_extents+0x5e2/0xb12
[1578930.563263]  insert_reserved_file_extent.constprop.0+0x98/0x2cc
[1578930.568469]  btrfs_finish_ordered_io+0x317/0x5d2
[1578930.573540]  ? __switch_to_asm+0x35/0x70
[1578930.578462]  ? __switch_to_asm+0x41/0x70
[1578930.583237]  ? __switch_to_asm+0x35/0x70
[1578930.587858]  normal_work_helper+0xd0/0x1c7
[1578930.592309]  process_one_work+0x16e/0x24f
[1578930.596748]  worker_thread+0x1e2/0x2b8
[1578930.601164]  ? rescuer_thread+0x2a7/0x2a7
[1578930.605469]  kthread+0x10c/0x114
[1578930.609594]  ? kthread_park+0x89/0x89
[1578930.613652]  ret_from_fork+0x22/0x40
[1578930.617653] Modules linked in: ext4 mbcache jbd2 macvlan xt_CHECKSUM ipt_REJECT ip6table_mangle ip6table_nat nf_nat_ipv6 xt_nat iptable_mangle ip6table_filter ip6_tables vhost_net tun vhost tap veth ipt_MASQUERADE iptable_filter iptable_nat nf_nat_ipv4 nf_nat ip_tables xfs md_mod nct6775 hwmon_vid k10temp bonding atlantic igb(O) edac_mce_amd kvm_amd ipmi_ssif kvm crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd cryptd mpt3sas i2c_piix4 nvme i2c_core ccp ahci wmi_bmof raid_class glue_helper scsi_transport_sas nvme_core libahci wmi button pcc_cpufreq ipmi_si acpi_cpufreq [last unloaded: atlantic]
[1578930.653701] ---[ end trace 2b07a24045c31257 ]---
[1578930.658298] RIP: 0010:__x86_indirect_thunk_rax+0x3/0x20
[1578930.662875] Code: 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 0f ae e8 <ff> e0 0f 1f 84 00 00 00 00 00 0f 1f 40 00 66 66 2e 0f 1f 84 00 00
[1578930.672370] RSP: 0018:ffffc90006883c28 EFLAGS: 00010202
[1578930.677088] RAX: 0000ac00e82e382c RBX: ffff888146124240 RCX: 0000000000000000
[1578930.681847] RDX: ffff888866b1a830 RSI: ffff888866b1a700 RDI: ffff88814b0f9bc0
[1578930.686550] RBP: ffff88814b0f9bc0 R08: 0000000000000001 R09: 0000000000000000
[1578930.691226] R10: 0000000000000001 R11: ffff888fce69fb40 R12: ffff88814b0f9c18
[1578930.695916] R13: ffff88814b0f9bc0 R14: ffffc90006883c98 R15: ffff888146124240
[1578930.700609] FS:  0000000000000000(0000) GS:ffff888fce8c0000(0000) knlGS:0000000000000000
[1578930.705373] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[1578930.710144] CR2: 0000000002f65000 CR3: 0000000004e0a000 CR4: 0000000000340ee0

After the restart i continued to get the PCI-E errors with the AQN-107, so i am unsure if the card is actually having issues or just continuing odd behavior of the board.

I re-formatted the cache drives which had btrfs uncorrectable errors, rebuilt the docker image file which became read only, and also pulled out the AQN-107 nic card for now to test and check, and hope it continues to be stable.

Overall i really want to love this board but its been some of the most peculiar bit of hardware i have worked with in a while.

1225

Finally, ASRock Rack has made Beta BIOSes public, a new sub-section (ā€œBeta Zoneā€) is available:

Havenā€™t been able to test it yet, should sport AGESA 1006.

4 Likes
1226

Nice find!

1227

@Mastakilla
There is no more PFEH setting in the latest 3.37 beta BIOSā€¦ Not sure itā€™s disabled or enabled.

1228

Can anyone explain please, why there is no ā€œAMD overclockā€ menu in bios? Is this menu only for ā€œXā€ processors? I want to oveclock RAM a bit, and cant find ddr-voltage setting.
X470d4u, Ryzen2700, KSM26ED8/16ME, bios 3.30

Summary

x470
x470811Ɨ609 90.6 KB

1229

Hi all,

I have recently obtained a copy of my X470D4U motherboard from Amazon and encountered similar problems to several users here (@Construct, @Shadowtm and jayzoose ).

Specifically, Iā€™m facing the following problems:

  • The motherboard doesnā€™t POST. No signal, nothing.
  • BIOS version is missing in IPMI
  • Dr. Debug doesnā€™t show anything
  • Only two green LED lights are shown (BMC and one next to the power slot).
  • Under System Information, it says ā€œPower Supply Errorā€, a similar problem faced by jayzoose.

I have tried various methods and suggestions but to no avail. I have done the following:

  • Flashed various versions of BIOS (3.37, 3.30 and 3.20)
  • Flashed BMC version 1.90 and 1.60
  • Tried different Non-ECC RAM Modules (I only have Non-ECC ones). So far Iā€™ve tested with Corsair Dominator (CMD16GX4M2B3200C16), A-Data (AD4U2666732G19-D) and Samsung (M378A2K43CB1-CRC). None of them worked.
  • Tried with different PSUs. (Corsair SF600, Corsair SF750 Platinum and a 1200W Gold ATX PSU)
  • Tried with a GTX 1080 Ti GPU

The motherboard is only equipped with one CPU (Ryzen 5 3600X), 1 memory stick and a CPU Fan. Thereā€™s a sticker on the board that says ā€œP3.30ā€, probably implying that the BIOS version is 3.30, but Iā€™ve no way to confirm this.

I have given up trying for now and Iā€™ve decided to give it another try by ordering an older CPU (Ryzen 5 2600X). In the meantime, I would like to know if anyone has encountered a similar problem and have succeeded in solving this?

Iā€™m at lost what to do and itā€™s extremely disappointing when it just doesnā€™t work.

1230

Iā€™d contact Asrock support.

1231

Same here, sucks but Iā€™d replace it via Amazon (might be faster than contacting ASRock Rack, depending on stock availability at Amazon). I think youā€™ve done about everything you can be expected to do.

This board is like a needy mistressā€¦

1 Like
1232

Thereā€™s unfortunately no stock on Amazon, so I will need to wait for a refund/replacement.

In the meantime, Iā€™ve sent ASRock an email. Letā€™s see what they say.

1233

Hi All,

Is X470D4U stable enough for a home server ?

Iā€™ve gone through some of the comments here, but due to the overwhelming count I canā€™t read them all, Iā€™d appreciate any input.

I read about that if you get a bad board, itā€™s really bad. But what about the good samples ?

I am looking for a home NAS ( Supermicro SC846 ) and X470D4U looked to be perfect as it has an IPMI, which based on some YT videos is cool. I am aiming for low-power setup like X470 + 3600 for the MB+CPU as the HDDs will eat most of the power. The alternative is some normal X470 Board, supporting ECC, but they donā€™t have IPMI.

So I am torn between getting X470D4U with chances things to go very wrong or a non-IPMI X470 MB.