10gb Nic and Proxmox/Debian

Hey all,

I’m having issues with this brand new network card I just bought from my proxmox server. I also just got the server, it’s a Dell R420 and the network card is a trend net TEG-10GECSFP(v2), which is just an aquantia NIC according to their driver that I downloaded and compiled on the proxmox host.

The issue is that I can see the NIC in proxmox and I assigned it to it’s own bridge(vmbr1) however I cannot get my container(owncloud) to be able to communicate from this bridge, it cannot even get a DHCP lease.

Here is the networking config for proxmox

auto lo
iface lo inet loopback

iface eno2 inet manual
iface enp8s0 inet manual
        mtu 9000


iface eno1 inet manual

auto vmbr0
iface vmbr0 inet static
        address 192.168.10.222/24
        gateway 192.168.10.1
        bridge-ports eno2
        bridge-stp off
        bridge-fd 0
#mgmt 1gig nic build into mobo

auto vmbr1
iface vmbr1 inet manual
        bridge-ports enp8s0
        bridge-stp off
        bridge-fd 0
        bridge-vlan-aware yes
        bridge-vids 2-4094
        mtu 9000
#10gig tp link aquantia nic

I am able to tcpdump from the proxmox host and see arp traffic and LLDP traffic but it seems like the driver for the 10gb nic is not working at it should.

According to my research the nic driver was allegedly in the kernel already but that did not work at all until I compiled it.

Here’s the into from ethtool for the driver.

driver: atlantic
version: 5.4.103-1-pve-kern
firmware-version: 3.1.77
expansion-rom-version: 
bus-info: 0000:08:00.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no

Here’s the lspci snippet
08:00.0 Ethernet controller: Aquantia Corp. Device 00b1 (rev 02)

Any help is appreciated! I was also considering just PCI passthru for this nic but I know that will just punt the driver issue to the guest OS so I’m not sure that’s more helpful. The point of this NIC is mostly just for whatever guest os/container I can get up and running for a “NAS”, since my switch has sfp+ 10gb I really wanted to take advantage of that throughput.

1 Like

Try setting a static Gateway and IP address for vmbr1 to test if you can get traffic through.

Just add:

address 192.168.10.xxx/24
gateway 192.168.10.1

Or set

dhcp4: yes

Maybe you need to reboot too.

Thanks for the reply, I was having some other issues with proxmox and this is a new server so I wanted to ensure all hardware was working correctly. So I nuked the proxmox install and went straight ubuntu 20.04 LTS server. Everything is working great except this darn NIC. I even got a new sfp+ cable to ensure that it wasn’t a bad cable.

Here’s the interface info:

2: enp8s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9000 qdisc mq state UP group default qlen 1000
    link/ether 3c:8c:f8:f9:8f:86 brd ff:ff:ff:ff:ff:ff
    inet 192.168.10.221/24 brd 192.168.10.255 scope global noprefixroute enp8s0
       valid_lft forever preferred_lft forever
    inet6 fe80::5e8a:6a72:f23a:41b5/64 scope link noprefixroute
       valid_lft forever preferred_lft forever

I’m using the built-in driver, info here:

driver: atlantic
    version: 5.8.0-44-generic
    firmware-version: 3.1.77
    expansion-rom-version:
    bus-info: 0000:08:00.0
    supports-statistics: yes
    supports-test: no
    supports-eeprom-access: no
    supports-register-dump: yes
    supports-priv-flags: yes

Dmseg is providing the following output:

[514156.089588] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514163.889106] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514189.869840] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514195.848942] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514213.969115] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514215.008929] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514215.469676] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514222.635414] device-mapper: table: 253:0: linear: Device lookup failed
[514222.635419] device-mapper: ioctl: error adding target to table
[514222.824109] device-mapper: table: 253:0: linear: Device lookup failed
[514222.824113] device-mapper: ioctl: error adding target to table
[514223.445117] device-mapper: table: 253:0: linear: Device lookup failed
[514223.445121] device-mapper: ioctl: error adding target to table
[514223.686749] device-mapper: table: 253:0: linear: Device lookup failed
[514223.686753] device-mapper: ioctl: error adding target to table
[514230.808931] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514268.489501] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514269.008786] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514316.188816] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514316.448685] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514318.009378] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514319.308681] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514328.688701] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514332.848595] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514335.849508] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514341.308692] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514351.468951] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514359.268592] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514411.448473] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514418.988438] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514419.469162] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514419.988425] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514426.928589] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514428.748390] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514544.428753] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514551.188078] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514588.268760] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514588.527965] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000
[514588.828205] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 10000 new 0
[514590.907972] atlantic 0000:08:00.0 enp8s0: atlantic: link change old 0 new 10000

This topic was automatically closed 273 days after the last reply. New replies are no longer allowed.