Gotcha. I have the hardware but I think it would add an extra layer of troubleshooting.
I tried RAID0 on both machines. Each RAID0 array is comprised of three Samsung 860 500GB drives to a total of approximately 1.5T space.
=============================================================
SYSTEMS
LS0000 - x470 ASRock Taichi Ultimate, Ryzen 2700, 10 Gbe Aquantia, Samsung 970 NVMe Pro 512GB, 64 GB ECC Ram, nVidia 760 Ti, PopOS 18.04 LTS, xfce4 (This remains the same), EXT4, RAID 0 - three - Samsung 860 500GB
LS0001 - x99M ASRock Fatal1ty Killer, Intel i7 6900K, 10 Gbe X540-T2, Samsung 970 NVMe Pro 512GB, 64 GB Non-ECC Ram, nVidia 970 Ti, PopOS 18.04 LTS, xfce4 (This used to have Windows 10), EXT4, RAID 0 - three - Samsung 860 500GB
=============================================================
NVMe to RAID0 copy of my 47GB testfiles on LS0000 give pretty stable 1.2GB/s. The same is true when copying from RAID0 to NVMe
NVMe to RAID0 copy of my 47GB testfiles on LS0001 tends to fluctuate between 900MB/s and 1.1GB/s. It does hit 1.2GB/s but less often. So I suppose that this is the chipset controller bottle-necking here?
The network copy results remain unchanged pretty much. The copy from/to LS0000 is still faster than the copy from/to LS0001 in that the LS0000 copies hit 350MB/s while LS0001 tend to be in the 200s (this is for when it is copying something like a 8GB ISO).
So I guess the conclusion here is that LS0001 the x99M system just can’t do it? I don’t think that there is much that I can do with it in terms of expansion. I would expect that the same is true for the other two systems Lenovo TS140 and T130: they just limited by the chipset and no amount of expansion would give a better result?
The only thing that I can’t try right now is swapping out the x99M rig for more up to date hardware. I’m thinking that if I do build something out, it will definitely be a Threadripper so I could get all those lanes.
Any thoughts?