I booted the desktop into windows 10 (21H1 build 190493.1348) and verified that windows saw the adapters as RDMA enabled
Get-NetAdapterRDMA
Name InterfaceDescription Enabled PFC ETS
---- -------------------- ------- --- ---
100G_1 Mellanox ConnectX-5 Ex Adapter True False False
100G_2 Mellanox ConnectX-5 Ex Adapter #2 True False False
I then ran the following against KSMBD:
diskspd.exe -b8M -c20G -d60 -L -o8 -Sr -t16 -W10 -v u:\iotest.dat
which resulted in approx. 32Gbit of traffic
I then enabled all KSMBD features:
sudo ksmbd.control -s
sudo ksmbd.control -d all
[ksmbd.control/700357]: INFO: b] [auth] [vfs] [oplock] [ipc] [conn] [rdma]
cat /sys/class/ksmbd-control/debug
[smb] [auth] [vfs] [oplock] [ipc] [conn] [rdma]
sudo ksmbd.mountd
Same Results and did not see RDMA used, so to ensure I’m reading the cryptic bracket [ ] system correctly, I ran it again after flipping the features:
sudo ksmbd.control -s
sudo ksmbd.control -d all
[ksmbd.control/705724]: INFO: auth vfs oplock ipc conn rdma
cat /sys/class/ksmbd-control/debug
smb auth vfs oplock ipc conn rdma
sudo ksmbd.mountd
Once again same result.
I’ll test Samba and Multichannel later this weekend,
Brian