USB Enclosure speeds much faster internally than via network transfer

I succesfully see 200MB/s with rsync internally from one data set to another but over lan with SMB and NFS it is painfully slow. Like 20 to 40MB/s. I know I know USB is not ideal for ZFS, but why would a network transfer be way more than halved compared to transferring between pools on the same truenas setup?

My network is mainly 2.5 and 10gbit devices with a few 5gbit. But everything should be able to see 250 or more MB/s. The devices I am testing are between 10gbit truenas and 10gbit linux pc.

Is this the one where you have Proxmox as the hypervisor, TrueNAS as a vm, and the disks in a usb enclosure passed separately to TrueNAS?

Proxmox hypervisor. Infact I think I updated it, I plugged it into the non proxmox hypervisor and it is working as intended. I plugged it into the usb 3.2 port.