Poor network performance after jumping to Fiber

Hello All,

I recently jumped to symmetrical gig fiber and am having issues with my guest vm’s getting very subpar network performance.

My setup is

pfsense router running latest version (whitebox)
6600K, 16GB RAM, Intel 82576 NIC.

vmware host running 7.0
Xeon D-1541, 64GB ram, Intel x552 and 82599 NIC’s connected with 10GbE SFP+ adapters.

I have my ONT connected to the pfsense box, the ATT router on another port and then an unmanaged gigabit switch connected to disperse the LAN side. Two connections go to my VMware host and are both configured as an uplink.

If I connect my laptop to the switch directly I am able to get Speedtests around 800+ both up and down. From a Windows based VM I am seeing 300/20. Linux based I see 300/300.

I’ve replicated the network performance issue in Proxmox as well making me think I have a hardware problem, or just poor configuration. Any thoughts on how I can further troubleshoot this?

Thanks

Check the VMware host while running speed-test. Are any of the CPU cores going to 100%? If so, you’re blocked on software virtualization.

I have not run VMware in a long time so I don’t know what’s available. But look to see if you can run a network device in the guest designed for efficient virtual networking. Or look to see if you can pass a virtual hardware device directly to your guests with SR-IOV.

Before doing more speedtests to the Internet make sure that your laptop on the switch can get 1 Gbps to the VMs.

SR-IOV provided the same performance as the VMXNET3 adapter. Host CPU utilization seems fine but I need to find a way to observe in a more granular manner to be sure.

I was using the CLI tool for speedtest.net, I couldn’t find an iperf server to target that was capable of gigabit transfers.

I recently switched to SpeedTest++ after stumbling upon it in another post

 Testing download speed (32) ..... Download: 1003.14 Mbit/s
 Testing upload speed (12) .... Upload: 315.20 Mbit/s

This seems that only the upload is suffering degraded performance. Downloading a large file I was able to confirm that I can see near expected downloads but the upload appears to be accurate at around 300 Mbit/s.

Sorry It took me a minute to get back to this.

On the host running a live CD I am able to see 800 down and 125 up. I believe the upload limit might be limited by the boot media. I’m going to get a spare SSD with linux on it to test again. I don’t believe there is going to be an issue with the hardware achieving the full gigabit speed.

My next immediate test is to rent a server capable of gigabit and run some iperf tests to have something more accurate.