Proxmox Bridge Speed

Operating Systems & Open Source Linux
, ,
1

Hi

I have a proxmox server

I’ve just got a new router (2.5G) and along with this I got some 5G network cards

I’ve swapped it all over and got the drivers working.

I have 2 NICS in the server - One is connected to the access point at 2.5G, however I’ve connected the other directly my pc with another 5G card; I was hoping to get 5G between them

It seems the bridge in proxmox is limiting to the slowest speed in the bridge though ? 2.5G

How should I set this up to get the full 5G but allow access to the rest of the network etc

2

can you share more information? Are the NICs connected via PCIe? If so, have you verified you have enough bandwidth?

3

NICs are connected via PCIe and I can see the speed of the direct to PC one is 5000mbs - I have no reason to suspect it is bandwidth.

I think the bridge is probably using the slowest available speed (The access point)

4

I don’t believe that is how it works.

5

Hm - You could be right

I just created an OVS bridge with the just 5 NIC - Still was around 2Gb

6

I will look at replacing the ethernet cable

It could be a el-cheapo ebay cable problem

7

If you want a direct connection with 5G, you need to (EDIT, cross cables are not needed these days) make sure to set an IP for both, i’m not sure how to do this for them.

After that you can access the server from that ip address. But if you want to make the computer use the server connection without setting that. You have to make sure the computer uses the 5g connection instead of the “normal” 2.5gbe connection.

to do that you can make an entry in the hosts file to point the computer IP to the 5Gbe connection.

You have to also make sure the 5gb NIC is routed in proxmox to the devices you want it connected to.

I believe proxmox will by default use a 10g or 100g virtual nic, to have fast transfers between virtual machines if they talk to eachother.

8

From what other people have said (Proxmox forum also) it seems like they don’t expect a bridge to use the slowest speed available across NICs.

This is in direct contradiction with something I found on google. So it could be unrelated

9

It’s currently using 10,000 - I’ve tested this with iperf between VMs/Host

10

Its a computer, it can’t decide which to use. It will just route stuff based on what you say.

If you want to connect to 192.168.10.0, it will use a NIC that has that ip address because the router has given it that ip.

11

I don’t think it’s routing.

I set up separate bridges to test - With just the single direct NIC connected. It still seemed to hit the 2Gb ish limit

12

So it’s a 5gb issue?
Did you install the drivers on the computer? Set the right settings? Is the link speed actually showing 5g?

13

Link speeds are showing 5G on both ends.
Drivers should be working as far as I can tell

1 Like
14

Did you install drivers on your windows pc? the default ones can work but with slower speed.
is both upload and download at 2gb ish?

15

Same up and down.

I have Linux everywhere, so no windows

16

huh weird. Can you try a speedtest directly from the proxmox host?

What are the 5g nic’s you are using? Do you have any packet loss?

1 Like
17

AFAIK any standard faster than 1 Gigabit has to be Auto-MDIX since it is using all pairs for send and receive at the same time.

Can you check what link speed is actually negotiated between the boxes? nevermind

1 Like
18

You are right. My knowledge is very old!

They already said the link speed is showing 5g on both ends.

1 Like
19

It is, yeah. No packet loss

It could be cable bandwidth? Would the 5g speed still negotiate if that was the case?

20

It wouldn’t negotiate 5g speed i think. This could be an issue with stuff like jumbo packets or still bad drivers. What NIC’s are they?