Hi.
Got a server on which I need to setup a storage system that needs to be as fast as possible.
Hardware is Epyc 7502p,
128GB ram in 4x32 3200 sticks
3 samsung Pm983 nvme drives
debian 10
I need the fastest thing possible for reading hundreds of thousands of small(up to 10MB) files and I was thinking
mdraid with the drives in raid0 or lvm with xfs on top, or btrfs.
These drives are rated at about 2GB/s reads, Is there a scenario where I could get as close to 6GB/s as possible, considering that data would be spread evenly(ish) among them ?
What do veterans recommend ? Also, what do you recommend tuning-wise, kernel parameters, mount options, filesystems etc.
PS: this is a small bench I ran over MD0+XFS
MD0+XFS
hdparm
Timing cached reads: 20958 MB in 2.00 seconds = 10490.85 MB/sec Timing buffered disk reads: 15928 MB in 3.00 seconds = 5309.13 MB/sec
dd write
dd if=/dev/zero of=speedtest bs=1M count=100000 conv=fdatasync
104857600000 bytes (105 GB, 98 GiB) copied, 44.9788 s, 2.3 GB/s
dd read dd if=speedtest of=/dev/null bs=64k count=1000000
65536000000 bytes (66 GB, 61 GiB) copied, 5.77544 s, 11.3 GB/s
But until I fill them up with data and actually start reading I don’t know how it will perform.
And experience beats benchmarks anyway.
Thankies !