TrueNAS Scale Performance Testing

Hardware Hub
9

Hmmm.

I think this may be inline with some of the information @wendell has shared in some of his testing over the years.
(151) Record Breaker: Toward 20 million i/ops on the desktop with Threadripper Pro - YouTube

Toward 20 Million I/Ops - Part 1: Threadripper Pro - Work in Progress DRAFT - Wikis & How-to Guides - Level1Techs Forums

When he is pushing PCIe Gen4 on ThreadRipper, I think it’s pretty obvious that both in terms of memory and CPU, that is really what’s holding us back.

I’m going to order this:
Linkreal PCIe 3.0 X16 to Quad M.2 NVMe SSD Swtich Adapter Card for Servers LRNV9547L 4I|Add On Cards| - AliExpress

To see if I can squeeze some more performance out.

And this!
M.2 Key Ssd Exp Card Anm24pe16 Quad Port Pcie3.0 X16 With Plx8724 Controller - Add On Cards & Controller Panels - AliExpress

These are the two differant PLX chips

PEX 8747 (broadcom.com)

PEX 8748 (broadcom.com)

I don’t know if an improvement in PCI-E alone will assist, but it’s not going to hurt (beyond my wallet) to try… I will update this once I receive them in a few weeks, obviosly have to wait for shipping from China