good timezone all,
my company is building a machine for local ai workloads. really just looking for any obvious issues with the below specs,
1-2x RTX Pro 6000
1x Threadripper Pro 9955WX
64GB DDR5
Asus Pro WS WRX90E-SAGE SE
Seasonic Prime 2200W
2x Samsung 9100 Pro 1TB
Get a better CPU with more CCDs, it’ll have higher actual memory bandwidth. Shoot for the 32c part although 24c should work fine.
Why would he need more memory bandwidth, he plans like 64GB memory, which is the bare minimum, it does not look like as if he would want to use CPU offloading or CPU inference. The two RTX Pro 6000 will do absolutely fine on a smaller processor. He would not even need a system that new for it.
@Reflected3771 maybe you can tell us more what kind of models you want to use and what you plan to do with it in detail.
Off the cuff, larger storage might be useful depending on the models and quants you’re looking to use. Like H-i-v-e mentioned, sharing what models and plans you have in mind will certainly help.
If there are no plans for the CPU then yes, the current config seems fine.
Seconded, we need to know what models and workloads this will be running to assess the build. 