A Neverending Story: PCIe 3.0/4.0/5.0/6.0/Sci-Fi+ | Bifurcation, Adapters, Switches, HBAs, Cables, NVMe Backplanes, Risers & Extensions - The Good, the Bad & the Ugly - Will there be a final solution?

This is a similar setup with a twist WisdPi PROM21 All in Expansion Card

You can choose Oculink-Oculink cable or a Oculink-4xSATA Port cable and configure it as such.

I did find files for using the B650 chipset as a switch. https://oshwhub.com/wesd/b650?jspm=hub.ss.lb.gc4&jlc_vid=EQNbBlIARgMKV1YFRQAKV1BWTlheBFRVQlJbVwBeQVgxVlNeQVReVVJWQVJXXjsOAxUeFF5JWA4dDxMOAgNABAsLWAQWFwgJBQQ%3D An add in board like the b650 ones, or a custom expansion board would give the Chinese laptop cpu motherboards some options.

1 Like

Serve the home has an article on a PCIe to E1.S and E3.S adapter.

Looks like thermal performance is pretty critical with them.

https://www.aliexpress.us/item/3256810463863201.html
Seems like quite a few of these are out now. waiting on e1.L bigger boy one

1 Like

Not separate chassis for them but here are a few chassis that support ATX style mobo and have beyond the usual slot count:

  • Any Supermicro 846x- and the 846xa
  • Any Supermicro 848- (not 848a or 848x)
  • Most of the Supermicro 747
  • Superchassis 842XTQ
  • Superchassis 418E16
  • X-Case X465E
  • Tupavco TP1846
  • Rosewill L4000B
  • Rosewill L4000C
  • Chenbro 41300
  • Silverstone rm52
  • Sliger CX3170a
  • iStarUSA D-414L-7
  • intel SKY-640 V2
  • Silverstone RM62-g04
  • Silverstone WS381-X (to be released?)
  • Silverstone Ultra Fort 5110 (to be released?)
  • Silverstone Alta T2 (to be released?)
  • SAPPHIRE INCA EP-10

These ones are proprietary but they support a lot of slots and I found them funny:

  • Supermicro 4028GR-TRT
  • Gigabyte G431-MM0

MINISFORUM ESP4B PCIe to 4 × NVMe M.2 Expansion Card. Seems interesting. It uses an
AMD B650/B850 chipset. Which i know has been done before. But it’s interesting seeing a product that appears to be more widely available for purchase. It also doesn’t seem too overpriced for what it is.

1 Like

I thought I might cross-post my thread here, as I started diving more deeply into internal bifurcation modes in ProArt X870-E:

It seems like PCIE_1(x4+x4) + PCIE_2(x4) + M.2_2(x4) bifurcation is possible, but it depends on the GPIO state on the PCIE_2 slot. :upside_down_face:

@vitabis I saw that you got a PEX88096 switch board working on AM4. Did it basically enumerate once you had the correct host adapter/cabling, or were there any special reset, clock, presence-detect or firmware requirements? I’m trying something similar with a Dell PEX89144 Gen5 switch board.

@itterative Did you ever resolve the issue where your PEX88096 showed correctly in lspci but none of the downstream GPUs appeared? I’m preparing a PEX89144 project and would really like to know what the final cause was.

@AllenLYTC3249 I saw your work modifying the PEX880xx SPI configuration and your comment that it might apply to Gen5. Have you done anything yet with PEX89000/PEX89144 hardware? I’m working with Dell PEX89144 switch boards and may eventually need to understand their existing Synthetic configuration.

The lekuo card is still very available Another B650 chipset pcie card spotted, Leikuo Southbridge Max - #4 by TheArkratos

There was one AM4 board where I had to set it to x8x8 for the switch to show up. Apart from that, no issues enumerating.

Started out with the ASUS ROG STRIX B550-F Gaming with the usual BIOS settings:

  • Above 4G decoding
  • Resize BAR support
  • ACS disabled
  • AER enabled

Got them daisy chained and running for a couple of months now (on AM5). Knock on wood.

Well it depends on what you want to do with it. More USB ports on the lekuo card is nice. But i am not a fan of the six pin power and the sata ports. And the ESP4B comes with a heatsink.

Thank you, that’s helpful. Could you share links or model numbers for your switch board and host adapter/cables? Did it work with the switch firmware as supplied, and was x8/x8 needed even with only one upstream connection?

Are there any solutions which work with a standard ATX motherboard in a standard ATX case? I see options for using risers from M.2, but nothing inside a standard case that doesn’t involve a hacksaw.

Do you have any images of this PCIe switch that you can provide? In fact, many OEM-produced PCIe switches do not follow standard pinout definitions for connections; they use their own custom wiring sequences.

Regarding the modification of the PEX89000 SPI configuration you mentioned, I think you first need to confirm whether your PEX89000 switch operates in BSW mode (Base Switch mode) or iSSW mode (Internal Synthetic Switch Mode). When running in BSW mode, you can indeed modify the SBR configuration using Broadcom’s SDK, similar to the PEX88000 chip referenced above. However, if it works under iSSW mode, this configuration method will not apply. The Internal Synthetic Switch Mode is generated via XML configuration files supplied by Broadcom, and these files are protected under NDA and cannot be easily obtained.

Moreover, to my knowledge, all current PEX89000 series chips have Secure Boot enforced. You must flash firmware files generated with the manufacturer’s keys into the SPI flash for the chip to pass verification and load the firmware. If the keys are invalid, the chip will refuse to boot.

All of this is quite complex. If you purchased the PCIe switch through official channels, I recommend contacting the manufacturer for technical support.