[SOLVED] High latency on local network | ASRock Rack ROMED8-2T/BCM

[Sawtaytoes]

For some reason, I’m getting very high ping on my local network only to this one ASRock Rack ROMED8-2T/BCM board.

The management interface gets <1ms ping.

The Broadcom 10Gb interface typically gets <1ms ping, but this is the second time I’ve seen it stuck at a pretty consistent 3ms ping. It only sometimes drops lower. Last time, swapping the SFP+ adapter fixed it, but this time, changing it resulted in the same latency.

It was connected to an SFP+ adapter on a 10Gb switch, so I tried swapping to a 1Gb port on a different switch, same issue. I tried switching to the other 10Gb adapter in both ports, same issue.

Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=2ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64
Reply from 10.1.0.6: bytes=32 time=2ms TTL=64
Reply from 10.1.0.6: bytes=32 time=3ms TTL=64

Restarting doesn’t fix it. Power-down and power-up doesn’t fix it either.

I tried an MTU of 9000; no fix.

What’s going on here?

[Sawtaytoes]

Today, the numbers are much higher, going up to 5-7ms average.

Anyone have any idea what could be causing it? Do these Broadcom BCM57416 have performance issues or something?

[Sawtaytoes]

A 100% full power down including unplugging both PSUs and then powering up again fixed it. Not sure if it’ll randomly have latency issues again or not though.

Just earlier, I was backing up files to the machine and noticed the transfer speed died down to ~17MB/s. After waiting 5-10 min, it came back up to 280MB/s (which is the highest speed I get over Samba) from my 2.5Gb NIC desktop.

This time, I swapped it to another port on my 10Gb switch as it could very well be that particular MikroTik SFP+ adapter or that port on the switch itself.