I have a 2x Epyc Rome linux workstation that I use for data processing of electron microscope images for a structural biology application. The data sets are too large to fit in RAM, and many of our algorithms need to access random subsets of the data at a time, over many iterations. The reads themselves aren’t that big (maybe 1-4 megabytes per chunk, where the chunks are randomly selected and usually not sequential), but we might need a few thousand of those chunks at a time.
I’d like to add a fast cache/scratch drive to this system to accelerate that random access pattern. I’m curious from those who have experience with linux nvme raid, if you think that a raid 0 of nvmes would be a good fit for this application (I know @wendell has lots of experience with nvme raid…). If not, what would be a good direction to go in for this? The motherboard only has pcie 3.0, I should mention…