Trying to install Firmware update on a Mellenox ConnectX3-Pro with Ubuntu 24. Can’t install the mft pcap. I want to connect it at 40gbps to an Arista 7050TX-72Q switch.
I just want to connect 40gpbs. Or do I need configure the switch? The 10gbps is work just fine.
what do you get with
#ethtool -m enp1s0f1np1
with Ubuntu it’s just
apt install mstflint
#mstconfig -d 01:00.0 q
ethtool -m br-645dc70dd615
netlink error: Operation not supported
I managed to update the firmware. But i want to connect to my Arista switch and i get no connection.
Check the switch port configuration and make sure you have the right cable typ for the card.
Also check the port configuration of your CX-3, if it is set to Infiniband, you must change it to Ethernet.
howto-change-port-type-in-mellanox-connectx-3-adapter
Have you installed the mellanox driver or is this Ubuntu out of the box?
Ethtool should show you something like this
[manja01 ~]# ethtool enp1s0f0np0
Settings for enp1s0f0np0:
Supported ports: [ Backplane ]
Supported link modes: 1000baseKX/Full
10000baseKR/Full
40000baseKR4/Full
40000baseCR4/Full
40000baseSR4/Full
40000baseLR4/Full
25000baseCR/Full
25000baseKR/Full
25000baseSR/Full
50000baseCR2/Full
50000baseKR2/Full
100000baseKR4/Full
100000baseSR4/Full
100000baseCR4/Full
100000baseLR4_ER4/Full
Supported pause frame use: Symmetric
Supports auto-negotiation: Yes
Supported FEC modes: None RS BASER
Advertised link modes: 1000baseKX/Full
10000baseKR/Full
40000baseKR4/Full
40000baseCR4/Full
40000baseSR4/Full
40000baseLR4/Full
25000baseCR/Full
25000baseKR/Full
25000baseSR/Full
50000baseCR2/Full
50000baseKR2/Full
100000baseKR4/Full
100000baseSR4/Full
100000baseCR4/Full
100000baseLR4_ER4/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: Yes
Advertised FEC modes: RS
Link partner advertised link modes: Not reported
Link partner advertised pause frame use: No
Link partner advertised auto-negotiation: Yes
Link partner advertised FEC modes: Not reported
Speed: 100000Mb/s
Duplex: Full
Auto-negotiation: on
Port: Direct Attach Copper
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Link detected: yes
[manja01 ~]# ethtool -m enp1s0f0np0
Identifier : 0x11 (QSFP28)
Extended identifier : 0x00
Extended identifier description : 1.5W max. Power consumption
Extended identifier description : No CDR in TX, No CDR in RX
Extended identifier description : High Power Class (> 3.5 W) not enabled
Power set : Off
Power override : Off
Connector : 0x23 (No separable connector)
Transceiver codes : 0x88 0x00 0x00 0x00 0x00 0x00 0x00 0x00
Transceiver type : 40G Ethernet: 40G Base-CR4
Transceiver type : 100G Ethernet: 100G Base-CR4 or 25G Base-CR CA-L
Encoding : 0x05 (64B/66B)
BR, Nominal : 25500Mbps
Rate identifier : 0x00
Length (SMF,km) : 0km
Length (OM3 50um) : 0m
Length (OM2 50um) : 0m
Length (OM1 62.5um) : 0m
Length (Copper or Active cable) : 1m
Transmitter technology : 0xa0 (Copper cable unequalized)
Attenuation at 2.5GHz : 2db
Attenuation at 5.0GHz : 4db
Attenuation at 7.0GHz : 4db
Attenuation at 12.9GHz : 7db
Vendor name : Volex Inc.
Vendor OUI : 14:1b:bd
Vendor PN : VQ2830LP100L
Vendor rev : 01
Vendor SN : Q28PL1020161S231
Date code : 200610
Revision Compliance : SFF-8636 Rev 2.5/2.6/2.7
Module temperature : 0.00 degrees C / 32.00 degrees F
Module voltage : 0.0000 V
[manja01 ~]#
1 Like
Settings for enp67s0:
Supported ports: [ FIBRE ]
Supported link modes: 10000baseKX4/Full
40000baseCR4/Full
40000baseSR4/Full
56000baseCR4/Full
56000baseSR4/Full
1000baseX/Full
10000baseCR/Full
10000baseSR/Full
Supported pause frame use: Symmetric Receive-only
Supports auto-negotiation: Yes
Supported FEC modes: Not reported
Advertised link modes: 10000baseKX4/Full
40000baseCR4/Full
40000baseSR4/Full
1000baseX/Full
10000baseCR/Full
10000baseSR/Full
Advertised pause frame use: Symmetric
Advertised auto-negotiation: Yes
Advertised FEC modes: Not reported
Speed: Unknown!
Duplex: Unknown! (255)
Auto-negotiation: off
Port: FIBRE
PHYAD: 0
Transceiver: internal
Supports Wake-on: d
Wake-on: d
Current message level: 0x00000014 (20)
link ifdown
Link detected: no
Identifier : 0x0d (QSFP+)
Extended identifier : 0x00
Extended identifier description : 1.5W max. Power consumption
Extended identifier description : No CDR in TX, No CDR in RX
Extended identifier description : High Power Class (> 3.5 W) not enabled
Power set : Off
Power override : Off
Connector : 0x23 (No separable connector)
Transceiver codes : 0x08 0x00 0x00 0x00 0x41 0x80 0x80 0xf5
Transceiver type : 40G Ethernet: 40G Base-CR4
Transceiver type : FC: short distance (S)
Transceiver type : FC: Electrical inter-enclosure (EL)
Transceiver type : FC: Electrical intra-enclosure (EL)
Transceiver type : FC: Twin Axial Pair (TW)
Transceiver type : FC: 1200 MBytes/sec
Transceiver type : FC: 800 MBytes/sec
Transceiver type : FC: 1600 MBytes/sec
Transceiver type : FC: 400 MBytes/sec
Transceiver type : FC: 200 MBytes/sec
Transceiver type : FC: 100 MBytes/sec
Encoding : 0x05 (64B/66B)
BR, Nominal : 10300Mbps
Rate identifier : 0x00
Length (SMF,km) : 0km
Length (OM3 50um) : 0m
Length (OM2 50um) : 0m
Length (OM1 62.5um) : 0m
Length (Copper or Active cable) : 2m
Transmitter technology : 0xa0 (Copper cable unequalized)
Attenuation at 2.5GHz : 6db
Attenuation at 5.0GHz : 10db
Attenuation at 7.0GHz : 0db
Attenuation at 12.9GHz : 0db
Vendor name : Arista Networks
Vendor OUI : 00:1c:73
Vendor PN : CAB-Q-Q-2M
Vendor rev : 20
Vendor SN : APV1851000AA
Date code : 181112
Revision Compliance : Revision not specified
Module temperature : 0.00 degrees C / 32.00 degrees F
Module voltage : 0.0000 V
looks good to me, except that your link is down, but you still need to check page 43
/sbin/connectx_port_config -s