Mellanox Connectx-4 paired with X870E motherboards not working

Hello,

I’m not really sure if I’m in the right place to ask about my issue, if I’m not, apologies.

I have an issue with my ConnectX-4 NIC, paired with a 10G sfp+ module base T.

This NIC works fine on 2 of my motherboards : Z790 Apex Encore & Z890 Apex. No issue at all, it just works. Unfortunately, these aren’t suitable for daily system and that’s where my issue is.

I had 2 motherboards for my daily system : an ASUS X870E StrixE and a MSI X870E Carbon Wifi. The first one was sent to RMA because the Realtek 5G NIC would crash when loaded and my ConnectX-4 wouldn’t work. The shop asked me if I wanted a swap to the MSI. I said sure.

The problem is that while the internal NIC works fine on this one, my ConnectX-4 still doesn’t work.

There is no light at all (right next to the SFP+) indicating if there is a link or not.

The NIC is detected on Windows 11, I can see both ports in the device manager, however it seems like it doesn’t power on my SFP. It is not being detected it seems.
I did test to plug the NIC on chipset PCIe lanes or CPU, it mades no difference.

I’m a bit clueless now, are there people with X870 motherboard with Mellanox NIC that works ?

Thanks a lot for the help

1 Like

A few extra informations : the card is flashed to the latest available firmware and isn’t vendor lock.

I tried using CSM instead of UEFI but same thing. The issue happens before Windows, in BIOS it doesn’t even have the link status ON, while if I plug the card on my Intel system, in BIOS the LED is already ON.

I tried forcing the PCIe speed to 3.0 but doesn’t work any better.

1 Like

are you sure it’s not a 25 gig NIC?

All my Connectx4’s are SFP28 25 gig
SFP+ plugs in, but is not recognized by the NIC

2 Likes

Yes I’m sure, I have been using it in 10G mode for a while on my previous Intel system.

1 Like

Did you install any driver manually or is this the Windows supplied one? It shows up ok in device manager (no question mark or so?)

Try rebar on/off?

Try with a live Linux distro?

I have a connect-x 3 that’s working fine on x670e, as far as that means anything…

I tried installing the latest drivers yes, but doesn’t do anything, the SFP+ doesn’t show up. The card itself shows up OK, no question mark in device manager.
I’m leaning towards power issue not powering on the SFP at this point.
Haven’t tried an other OS as from my understanding the issue happens before any OS if my z790 plateform is any exemple (in z790 bios, the LED Status is active).
On X870E, at no point at all during the boot process the LED status turn on.

1 Like

I just tried on my X670E Gene, the card works there, with LED Status being green from the moment the system is being turned ON. So it is limited to X870E chipset

forgot to read this part

You are booting the card using EFI for that slot?
No bifurcation?

Fast boot disabled?

1 Like

UEFI only for my Z890 system as CSM isn’t there anymore, works.
On X870E, I tried with CSM and UEFI, same thing, doesn’t work.
No bifurcation. Also tried without fast boot.

Are we sure there’s enough PCIe lanes available and active on that slot?

Unsure if that slot is pulling from the PCH / sharing lanes with M.2 devices

1 Like

Yeah I’m sure, I tried using different PCIe slot, even the main GPU one. Same exact result.
Also important to note that it happens on 2 different X870E boards, from 2 manufacturers (ASUS/MSI)

1 Like

What CPU are you running?

Per Asus: ROG STRIX X870E-E GAMING WIFI | Gaming motherboards|ROG - Republic of Gamers|ROG Global
AMD Ryzen™ 9000 & 7000 Series Desktop Processors*
1 x PCIe 5.0 x16 slot (supports x16 mode)
AMD Ryzen™ 8000 Series Desktop Processors*
1 x PCIe 4.0 x16 slot (supports x8/x4 mode)**
AMD X870E Chipset
1 x PCIe 4.0 x16 slot (supports x4 mode)

Bottom slot is x4 only when you have an M.2 in either slots above the GPU. In your pic the heatsink is installed, so that may be the problem.

1 Like

I’m using a 9800X3D, also my current board is the MSI X870E Carbon Wifi. The asus one got sent back.

.
I tried all 3 slots, same story every time.
When I was on the ASUS, I made sure to be careful of that, not using M2 slots that would cut the PCIe lanes.

1 Like

Connectx4 is a x8 card, did you lock the top slot to PCIe 3.0 when you tried it?

1 Like

Yes I did set all of them to PCIe 3.0. However it being X8 doesn’t mean it won’t work on X4. This is how I was using it before

I do not have 10 gig cards, but can confirm the 25 gig CX4121A does not function on PCIe x4 slots.

That’s fair I only use 10G. Either way it should have worked on the x16 slot if it was the issue :frowning:

1 Like

I spun up a machine with the card installed to find out when flipping through this thread.

No dice on x4
Does work on PCIe 4.0 and 5.0 slots though.

Unsure what’s goin on with yours.

Yes this is very frustrating as I can see it working just fine on 3 others platform but not the one I want it to be. I guess I could contact MSI support.

SFP28 is supposedly backwards compatible with both SFP+ and SFP. I understand compatibility in general between cards and transceivers is a bit so-so though. But in theory, an SFP+ transceiver should at least have a chance at working in a ConnectX-4 card.

(NVIDIA lists these as 25/10 Gbit/s cards.)

3 Likes