Using many M.2 SSDs on an older AM4 board

I am looking for help with setting up a new SSD based NAS to replace my older NAS with 10 4Tb HDDs.

I have a few M.2 cards that are salvaged from older machines - a range of 1 TB, 2Tb and 4Tb cards. I also have several B550 based AM4 motherboards, CPUs and ram.
After seeing some videos recommending LSI-9500 8i TriMode Cards, and HP Trimode backplanes, I bought a pair of each, and put some of my older SATA cards in them - so I know the cards and the backplanes work.

I see startech has U.3 to m.2 adapters, but they don’t seem to work with my setup - the 9500 card doesn’t see the u.3 adapter. I ensured the firm ware is set to multi mode, so I am pretty sure that is set up right.

Am I going down the wrong pathway here? Or are there better ways to get 8-10 M.2s onto a B550 based motherboard? (I need to use one of the x16 slots for GPU, and a PCIE4x1 for my 10 GBps card.

The SATA and NVMe protocols are not compatible, meaning a U.3 drive cannot be used an a tri-state enclosure. What you can do is purchase a supply of SATA to M.2 adapters. These usually (but not always) come in 2.5” enclosures, which can then be mounted as regular 2.5” drives. Aliexpress is a good source (or was when I got mine, years ago).

I actually had a follow-up order last year I’d forgotten about and the ad is still up:

click ←link

HTH!

1 Like

Thanks - these would probably work for me. A video from Raid Owl (I made a custom tri-mode NAS…with a Mini PC) said they used U.3 drives, its possible the Startech adapter doesn’t work with the cage.

Those wont work if you are using nvme ssds.

Yes- the SSDs are NVME, which is why I wanted the U.3 adapter to work

Sorry, you’re right, I’m using these with SATA M.2 drives. :anguished_face: I have different ones for some NVMe drives, be it I also use a 4x M.2 to PCIe x16 adapter for those, with 4x4x4x4 bifurcation.

Have you tried using other M.2 ssds with the U.3 adapter? The LSI-9500 8i and backplane are probably splitting the lanes into 8x Pcie x1. And not all M.2 ssds like to run at Pcie x1.

There are cards with a plx pcie switch and up to 8 m2 slots on ebay and aliexpress from china. And also other vendors but the china cards are usually cheaper. Its a lot less fuss than a broadcomm card, the cables and a backplane and u.2 adapters

Like this for pcie 3.0 https://it.aliexpress.com/item/1005012497825604.html

Or this one for pcie 4.0 https://it.aliexpress.com/item/1005012706769610.html

Only thing I’d add is with AM4 & B550 especially is get your calculator out for PCI Gen x Lanes for each slot you intend to use with multiple n-way adapters. Keep in mind a lot of boards will disable a full slot if you populate onboard M.2’s so I’d probably count them out (in favour of hosting 2 * 4 way riser cards in the fastest slots). And all the slots might not all be PCI-E Gen 4 either.

If you haven’t yet, go through the manual over its lanes/slots with a fine-toothed comb. and then again.

A -G CPU (iGPU) will help with arranging slots. If you need all of that and with a GPU, then B550 is going to compromise somewhere, you get to decide where that is.

1 Like

Which motherboards do you have and how many of the M.2 drives are NVMe versus SATA? If a mobo’s the usual two M.2s on the board with 4+ SATA off the board’s chipset then there should be plenty of ports with a 9500-8i.

That said, Promontory 21 cards are another option for M.2 slots besides the PLX cards @starshipeleven mentioned. Leuko Southbridge Max and WisdPi PROM21 are both 4x M.2. Both also provide 4x SATA as well.

Your best move here is likely selling the board and getting a X570 off ebay. Preferably something with very flexible lane configurations like an asus crosshair dark.

Even that will only get you to 7 SSDs at X4 though (most through chipset) so you’ll need PLX pcie switches beyond that.

1 Like

I’ve had nothing but rather bad experiences with tri-mode HBA’s.

They do some sort of internal processing and present NVMe drives to the OS as if they were SCSI/SAS drives and this slows the whole process down significantly due to the latencies involved with that conversion.

SAS9400 adapters are particularly bad. SAS9500 adapters are a little bit better. SAS9600 adapters are the best, but they are still rather expensive and even these will have much reduced performance compared to running the drives natively.

Additionally tri-mode adapters can be finicky and have weird compatibility issues and other conflicts.

I have honestly never heard anyone say anything positive about tri-mode adapters.

If I had to use a large number of NVMe drives on a board with few PCIe lanes, I’d probably max out the few on-board m.2 ports there are and get a 16x to four m.2 adapter riser (assuming the motherboard supports bifurcation) and use that.

There are some PCIe switch products that can also be useful, but they tend to be frighteningly expensive to the point where they just aren’t worth it. (that, and they tend to be limited by upstream bandwidth constrictions, and add undesired latency, though a lot less bad than tri-mode adapters)

Using tri-mode adapters would be a very last resort.

And all that said, I’d argue that there is a rather limited point in using NVMe for NAS (other than maybe as a cache device to help speed up slower devices).

If you really NEED SSD’s for this NAS, one of the more affordable ways to accomplish that right now is to get decommed high write endurance enterprise SAS SSD’s from tech recyclers or on eBay, and hook them up using actual SAS on an older SAS9300 HBA. They won’t have has high peak performance as an NVMe device does, but they will be much more stable under load as they generally don’t have volatile SAS caches that run out followed by much slower write performance.

And if you look around you can even set up so called “wide mode” with dual port SAS devices which can get you quite good performance, up to dual SAS3 port bandwidth (using multipath IO) up to about 3GB/s if the drive supports it, though it does require special breakout cables.

All of that said, while there are workarounds to get old consumer hardware to work in this application, the more capability you ask from it, the more ghetto it is going to get. I’d argue that for any server that runs 24/7 you are going to want ECC and an official server CPU (Epyc/Xeon) or at the very least something like an ASRock Rack server board designed to use consumer AM4/AM5 CPU’s

I tried getting an x570 off Ebay- bought one, the seller tested it, and it wasn’t stable. Tried another, and they had issues. so much for trying to save money by reusing things I have :slight_smile:

The problem with the AM4 chips with an iGPU is that they drop everything to PCIE3 (I just learned that). I don’t need much GPU for this, so I can probably just take a riser off an x1 slot for the GPU, then use the PLX switch. I’m looking at what I can fit on the MB

I was able to get a real U.3 Drive, and it appears perfectly fine, so my guess is the StarTech M.2 NVMe to U.3 Adapter doesn’t really support this.

Some of them can boot without any GPU/iGPU whatsoever

You totally just solved a problem for me.

Thank you, I just gained a pcie slot back on my threadripper!

My $.02: Sell the HBAs and backplanes as well as all the small m.2 drives. Run up to 5 m.2 drives with one in the CPU m.2 slot and 4 in an x16 adapter. Video card and NIC plug in to chipset PCIe slots.

Once you’re buying HBAs or PLX cards you’re spending money without getting storage for your $, which is a little counterproductive. PLX cards with lots of lanes tend to be pricey. PCIE 3.0 cards are a good bit cheaper than 4.0 cards.

Or: this card is legit: Amazon.com: KONYEAD Quad PCIe4.0 NVMe M.2 SSD Adapter Card-PCI Express 4.0 x8 Card Support 4X M.2 NGFF PCIe NVMe SSD for Mac & PC (IX8024 Switch)-Support Non-Bifurcation Motherboard(3005K) : Electronics
Get an x570 board that splits x16 into two x8 slots, and you can have 9 m.2 drives.

1 Like

Standard desktop mobo will not have the pcie lanes you need to run all those devices. In most cases, desktop boards will only have one 16x pcie which will be logically split into two 8x 8x lanes if the 2nd physical 16x slot is used. Even for x570 boards, they will add a dedicated controller chip to run a second nvme slot. Best I’ve seen for AM4 is 8x 8x 4x pcie 4.0 on a desktop board with 2x m.2.

Based on your system layout.

Gpu x8

HBA up to 16i x8

10Gb nic x4

You’ll need an hba 16i with m.2 to sata adapter to make it work since I don’t see you having enough pcie lanes for 2 hba cards.

This is probably the cheapest pcie gen 4 switch card, 8 slot m.2 you can find.
It will give some better system bandwidth in half or x4 slots. I run 2 of them currently.
The top 2 mcio i8 connectors shares the x16 underside. And used as alternative to connect it up your pc, devices on the mcio connector wil not function.

Skip trimode hba’s in general for nvme as the latency is much higher than native nvme on pcie