I maintain roughly 30TB of large video files utilizing Windows Storage Spaces. I’d like to make a new system using Ubuntu and ZFS (if the numbers make sense).
One of the biggest drawbacks to Storage Spaces is the overall performance, especially write performance. This has been a large bottleneck trying to get to a 10Gb network setup. And now that the SS Pool is in place, I can’t make any changes to it for performance. I’m forced to build a new system.
I hoard videos. Each file is about 8 to 24GB.
I’m hopeful that ZFS Raidz2, and some hardware changes, can get me to the sustained write performance I desire (400+MB/s would make me very happy).
EXISTING HARDWARE (on new server)
1x Intel - Xeon E5-2670 2.6GHz 8-Core Processor
1x ASRock EPC602D8A LGA 2011
2x Samsung - 850 EVO-Series 250GB
2x Plextor M8Pe(G) 128GB NVMe PCI-Express
8x 4GB RAM HMT151R7BFR4C-H9
16x HGST 8TB Ultrastar He8 HUH728080ALE604
I’d like the write-back cache of the Pool to sustain, worse case, 100GB of data per transfer, at 400+MB/s. Is this possible, and how can I get there? Is an NVMe SLOG the answer?
Whichever strategy is needed, I need the write-back cache to be only for write-back. If the system is going to place recently used or high demand data there, all it takes is a few video files, and the cache could be full. Can you have a write-back cache in ZFS that is write-back only? (I’m OK with the NVMe drives sitting and doing nothing most of the time if that’s what it takes)
Do I even need to worry about this? Will the performance of Raidz2 be enough on its own?
Also, is 400+MB/s unrealistic?
Ultimately, the ZFS server will become the primary machine, and the current Storage Space server will be blown up and rebuilt, becoming a full backup.
Thanks in advance for any assistance