A Neverending Story: PCIe 3.0/4.0/5.0 Bifurcation, Adapters, Switches, HBAs, Cables, NVMe Backplanes, Risers & Extensions - The Good, the Bad & the Ugly

Are you able to connect an SSD to your unit of the Adaptec 1200P that has support for an SSD manufacturer firmware update or status tool?

We know from @twin_savage that at least CrystalDiskInfo can access the SSD’s controller which is unthinkable with Broadcom Tri-Mode HBAs.

But that renaming of the connected SSDs (“NVMe” as a prefix and “SCSI Disk Device” a suffix) rubs me the wrong way, like seriously man!

I’m having issues with DigiKey since they want me to send them copies of personal IDs which is a big No-No for me and I’m wondering how that can be GDPR-compliant.

3 Likes

I’m seeing contradictory information depending on what utility I run to look at the NVMe drive’s connection type under Windows, however keep in mine I’m using that sketchy M.2 adapter which could be adding to some of the weirdness here:

SeaTools claims its a SCSI disk:

I trust hdsentinel more and it says it’s a defeatured NVMe connection:

attached via raid card

other NVMe drive natively attached for reference

3 Likes

Technically no, because the Adaptec manager utility takes over that function:

3 Likes

That’s helpful! :star_struck:
Could you expand out the “Storage Controllers” section as well too please? That would tell me a lot more.

Even better would be:
1.) View → Devices by Connection
2.) Then expanding out the tree until you run into the storage medium.

E.g:

I’m sorry but it seems like a big fat RIP on low-level access to the drive through the 1200p, at least on Windows. (Unless the software doesn’t support the 7500 series, but I really doubt that.) Surprising that hdsentinel isn’t able to wring out much useful data from the drives either, only some very basic stuff such as temperature and power-on time. It does identify them as NVMe however, not SCSI.

4 Likes

A little off-topic, but could someone bless me with the 1.0 firmware for the Broadcom p2411w? (Is it even possible to downgrade those things?) Otherwise I have an expensive paperweight on my hands…

Downloads → Firmware → Archive

2 Likes

Thank you! I saw that, but that only goes back to 4.1.1 for me, or is that what I’m looking for?

If you don’t have a fancy active electronic UBM backplane you have use the firmware from Broadcom’s website up to including the package listed as P14.2. Successfully up and downgrading firmwares hasn’t been a problem for me.

Any firmware newer than from the package P14.2 will result in the P411W-32P not detecting anything directly attached to it without such an UBM backplane as a go-between because Broadcom actively removed the feature of being able to use directly attached SSDs (which is a retarded move since this HBA ONLY works with PCIe NVMe SSDs, but that’s Broadcom for you).

The two units of the P411W-32P I have had in my grabby little fingers came with an ancient (pre-release?) firmware that identified itself with the version 0.1.0.0. That old-AF version isn’t anywhere publicly available to download as far as I know.

3 Likes

Ah alright, I understand. I misunderstood the earlier parts of the thread, I thought you needed that 0.1.0.0 for direct attach disk compatibility. I’ll just get the 14.2 then, thank you very much!

WRT the Adaptec cards:
So I tried to set one of the NVMe drives as Secondary “Boot Type” thinking it might expose the drive in a different way and I basically gave myself a heart attack.

The system would lock up after a couple minutes of use (be it in BIOS, OS, UEFI shell) after I had done this or fail to boot completely. I pulled the raid card out and the behavior persisted, I pulled out all the NVMe drives and the behavior didn’t change.

Eventually I just pulled the battery out of the motherboard and let it sit several hours and that seemed to cure it. I’m not sure what happened, perhaps some kind of buggy UEFI entry happened, but I don’t wish to repeat it.

2 Likes

While randomly looking through AliExpress listings I got recommended this thing:
https://www.aliexpress.com/item/1005005842274516.html
Assuming it actually uses the advertised ASM2824 switch it should actually be Gen3 and not Gen4 and x8, not x16. The listed throughput is 64Gb/s which matches Gen3x8. According to ASMeda product brief (why share the datasheet with the pleb, huh?) the switch should support hot plug and up to 12 downstream ports.

Does anyone have any experience with this controller? Since it’s a switch it ticks most of the boxes, but then again it’s just Gen3x8 total. I’d also be interested in knowing how it handles H10s/H20s :slight_smile:.

Well, I bought one for a PCIe 3.0 computer of mine that has some spare slots and no bifurcation support.

And by “I bought one” I mean I bought a different item:

https://www.aliexpress.us/item/3256805627893483.html

Looks to be mostly the same, but with a fan on the switch and a heatsink on the SSDs.

There’s no external power plug on either card, which is interesting as an M.2 drive can pull close to 20 watts these days, and I’m sure the switch is fairly costly as well. Aren’t x8 slots limited to 25 watts? But even if it gets the 75W allotted to an x16 slot, that might not be enough. Depends on what you plug in it I guess.

Interstingly, I can’t find anything about power draw of “current era” M.2s. I know H10s pull ~5W max, 970 PRO similarly 5.2W-5.7W depending on the model - those are Gen 3 drives so more relevant for the card.
990 PRO (Gen4) lists 5.4W/5.8W active so not much change here.

You can always mod more power delivery if it turns out to actually be a problem :wink:

Are you sure?

The maximum I’ve ever seen with M.2 PCIe SSDs is about 10 W which is edging the PCIe spec for the 3.3 V slot power delivery. Even M.2 SSDs with powerloss protection like the Micron M.2 7450 models max out at little over 8 W.

And these guys get so hot that you absolutely have to use a heatsink or blast them with a 120 mm fan at close range at max RPM to keep them in check.

(I have recently built with these SSDs since M.2 NVMe + Powerloss Protection was a requirement and was surprised how “wow, actually darn hot” 8 W can get on a 22 mm x 110 mm PCB. Note: If you want to test your SSDs’ cooling solution hit them with continued random writes)

Are you maybe mixing up M.2 and U.3/U.3 SSDs?

1 Like

I’m probably wrong. I have this 17W number in my head for the Sabrent Rockets, but I can’t for the life of me find anything online to back it up.

On the other hand, Asus’ Hyper Gen5 M.2 carrier for 4 drives has a 6-pin PCIe power connector so they were clearly expecting to go outside 75 watts with it; and that’s just a dumb bifurcation-based adapter with no electronics. But that’s not proof of anything of course.

I see others here have the Adaptec 1200p controller so am looking for some help. I have the 32i variant with four u.3 tri-mode cables (ACK-I-SlimSASx8-8SFF-8639x1-U.3-0.8M):

Links to the controller and cables

Controller : https://www.microchip.com/en-us/product/HBA-1200up-32i
Cables : https://www.microchip.com/en-us/products/storage/adaptec-cables-and-accessories

I set the controller to Direct Attached and 8 device mode. It works perfectly fine with SAS HD’s and SAS SSD’s but none of the u.2 NVME drives I have tried will detect. Having said this, I also have one of these generic DiliVing u.2 SlimSAS cables:
https://www.amazon.com/Diliving-SFF-8654-SFF-8639-SlimSAS-Adapter/dp/B098JBS7QD/ref=sr_1_1?crid=311I5VOCDDLV5&keywords=DiliVing+SlimSAS+8X+to+2*U.2+NVMe+Adapter%2CSFF-8654+74pin+to+2*SFF-8639+68pin+Cable+with+Power%2C+75CM(Broadcom+MPN+05-60005-00)&qid=1706856009&s=industrial&sprefix=diliving+slimsas+8x+to+2+u.2+nvme+adapter%2Csff-8654+74pin+to+2+sff-8639+68pin+cable+with+power%2C+75cm+broadcom+mpn+05-60005-00+%2Cindustrial%2C308&sr=1-1

Putting the controller into Direct Attached with 2 devices mode and the generic DiliVing cable works, but only sees one drive. What am I missing here?? Its got to be something stupid.

For the u.2 cable/drives you need to set the connector to direct-attached cable with 2 devices mode

image

3 Likes

I can’t help out, yet since Digi-Key still haven’t processed my order of the 1200p-32i :frowning:

1 Like

U.2 NVMe drives won’t work with U.3 hosts. U.3 drives are backwards compatible with U.2, but the other way around won’t work.

Wikipedia because I can’t find a better source:

2 Likes