I am new to this forum but follow the youtube channel and after the friendly invitations in the videos I thought I try my luck here.
I am not a complete novice to building computers but also no a pro. My last build is quite a number of years ago. I need a complete new rig primarily for heavy lifting deep learning NLP applications. Plan is to train test locally and then burst compute on the cloud.
But I also need to use the rig for several systems (pass through → potentially at the same time) and maybe some occasional graphic work / renders but nothing too intense on that end I guess.
Please note that NLP usually takes a significant amount of GPU RAM on the engaged graphic units.
Here are the proposed components and resulting question of which I hope you can answer. I plan a 4 screen work setup.
Processor: AMD Ryzen Threadripper PRO 3955WX, 16x 3.90GHz
MB: ASUS Pro WS WRX80E-Sage SE WIFI
Cooler: Fractal Design Celsius+ S36 Prisma
- Trident Z NEO either the
- gskill(dot)com /specification/165/326/1562840280/F4-3600C16Q-64GTZNC-Specification
- gskill(dot)com /specification/165/326/1582265908/F4-3600C18D-64GTZN-Specification
SSD: something like the Samsung SSD 970 EVO Plus 2TB, M.2
HDD: anything really
Case: be quiet! Dark Base Pro 900
Power: be quiet! Dark Power Pro 12 1500W
GPUs: no this is where it gets interesting. I am planning for 3 GPUs. 1 system one and 2 for combined and/or individual passthrough.
Potentially something like this:
- MSI GeForce RTX 3070 Suprim (system)
- MSI GeForce RTX 3090 Ventus 3X 24G OC (2 of those)
Can the MB actually fit all 3 GPU’s and potentially even the motherboard included Hyper Quad 4xM.2 adapter? That is pretty much my biggest worry right now. PCIe slots are 20mm apart from each other. 7 slots make for 6 “gaps” which makes about 12cm of space. However each graphic card is about 6cm thick from what I can see in the specs. That basically rules out 3 and means 2 cards will fill pretty much all 7 slots? This can’t be right…? What am I missing? And if that is the case what are my options?
Question 2: Worries about power. Is the Dark Power Pro 12 1500W enough?
Question 3: I’ve read several times now that passing through 2 identical cards that are the same can result in problems. However the main system card would not be. Is that still a problem. Does anyone have experience with this?
Question 4: I’ve listed two options for RAM here. Surprisingly the first one (which has less size per component: 4x16GB) is more expensive. I am no expert in RAM. Looking at the specs it seems that the latency is higher in the 2x32GB components. However I am trying to maximize RAM in the machine if possible. What are the trade offs here? Does any of that RAM work for the system (amd(dot)com/en/products/ryzen-compatible-memory) ?
Question 5: Is there anything else in this system which isn’t going to work or will be problematic? Any better GPU options (Note: I don’t want to get a TPU)
Also did I forget any components? Does the cooler need some kind of “paste” onto the processor (god… haven’t done this in a long time )
Question 6: Is the case large enough with 577 x 243 x 586?
As mentioned introductory I am hoping to setup several different pass throughs for different things. Most will just use one GPU while the main one will need to have 2 GPUs passed through for heavy AI lifting. But at most 3 systems (main + 2 passthrough systems) would be running at the same time.
Thanks so much for the help. Much appreciated!