I would rather not deal with truenas forums as they are useless. I had no issue with my read and write speeds with my previous truenas system. But it seems the newer one is nothing but problems for this usb enclosures. I cant get it to have reads over 50MB/s and 70MB/s writes. Truenas does not output health for all the drives, I have to manually run it and manually running via ssh outputs that the disks are healthy. So I am not sure where to go from here. My previous setup was running the disk in proxmox and mounting them to the truenas vm so it could see them. At this point I am running them on a non vm system. Just truenas native. Before proxmox was monitoring the health.
The true nas forum mentioned smr drives thing is they are absolutely not smr but cmr. I had these drives working fine before in both a previous truenas build and a synology station. I vaguely remember a hack with like read write cache of the drives I just dont remember what it was to get truenas to work well before.
First step is removing usb enclosure from equation, its unknown, complex and generally unsupported factor.
Its very likely the sata ↔ usb controller that is giving you grief here, but good solving this other than removing it altogether.
Is there good reason beyond ease of installation for using it? Direct connection to plain old intel/amd sata chipset is the best starting point and least problematic solution.
Cannot do this. I have no extra space in the case nor add in card availability. I have to use the usb. What I did to get it working was remove native truenas and now it is working. Basically connecting usb enclosure to proxmox and reverting back to truenas vm. They literally were in a system prior to this direct to chipset but that system died in a firey blaze of glory. Basically It is fine in truenas vm inside of proxmox but not native os on physical hw. not vm.
Well I did usb passthrough and non usb passthrough method. Seems there is a bottleneck on the vm as well as native system for simple usb and zfs, however passing through without usb but adding each individual drive to vm in pve nets 4 times the speed. it is back to 50MB/s with usb passthrough. Something about truenas really doesnt like anyform of usb. But if proxmox handles the hdds and passthrough the drives with vm config it is fine.
If I have the above in it is fine if I passthrough usb and not have above (pass entire dock to the vm) it is not fine.
If proxmox passthrough drives individual instead of entire enclosure i see 200MB/s if I pass entire enclosure I see fluctuations between 1MB/s to 70. So something about how truenas thinks they are individuals drives or entire enclosure causes the issue.
I am testing nfs share transfer to a nvme ssd on my main system.
When I leave usb mounted to host proxmox system and passthrough not with usb passthrough but mount via vm config each drive i see much better speeds. When I passthrough the usb device in its entirety so proxmox doesnt see it or interact with it, it is slow again. Now it seems to be something specific to truenas because a proper vm with ubuntu and nfs and zfs sees the better speeds as well (passed through usb).
At least the 0EFAX drives while not being SMR they’re quite slow (“5400 RPM-class” and quite slow even having that in mind) so that would explain your poor performance especially if you’re trying to use all in a single array.
They were all in Synology and I saw proper speeds. Passing the hdds as individual drives and then as a single pool of 5drives. Speeds are what I expect. But not passing individual drives but all drives using USB passthrough that proxmox features truenas struggles hugely.
I cannot find any documentation on this model of 10tb. All I see is userbenchmark stuff and that is about as reliable as finding a grain of salt on a beach. I may recall it being 5400rpm. But I am trying to identify the other as well. Userbenchmark shows a read and write speed of 180MB/s but searching theoretical speed of 5400rpm it seems 100 is more of a thing.
all of them are 5400rpm. I still would imagine faster speeds than 50MB/s for a 5 wide pool. Also as I said I found a work around which quadruples the speed. So I just don’t know.
That’s definitely not recommended. I mean, it could work as a one time data recovery/resilver attempt or something like that, but I certainly wouldn’t do this on the regular, unless those drives contain throwaway data you don’t care about…
Just an update. I saw 500MB/s for once transferring to a ssd, might have been a bottleneck of my drive it was transferring to. But also not sure about that.
I had a series of USB issues when I bought my last VR headset. I found this program which allows you to see very detailed information on all USB gear on your PC. I used it and resolved the driver issues which fixed my problem. Just throwing it out there.
