What’s the cheapest way to get a high scaling efficiency tensor parallel rig for 8 GPUs?

When you scale past 4 GPUs your 2 biggest problems become power and cooling.

Get a case with power distribution board designed for this specific deployment scenario like The Rig 3.0 or you are going to spend weeks cooking things, chasing signal quality problems that are actually grounding issues, etc.

Depending on what your software is doing, that dictates the hardware design. With tp8 blackwells on large moe models, the dual turin 160 lane approach actually beat 2x cpayne switches in pure performance. Come to the discord and hang around the hardware channel to see all the unhinged builds people have made.

2 Likes