Hello everyone!
New to the Community and this is my first post. Please let me know if I missed some important rules or maybe a related post.
Please excuse the verbosity of the post, I want to make sure I give a solid overview.
I’d like to ask for some guidance/feedback on a local AI build I’m trying to put together. I think the rules mentioned that I can’t post (many) links before having a high enough trust level so I’m just giving the names of the parts here but I can obviously provide links later on.
I do have a background in computer science but my education was mainly software side and rather theoretical. I do know how how “AI” works from a theoretical point of view as well as the math behind most of it, however I am not really familiar with hardware and I tend to get overwhelmed by all the choices, different platforms and considerations regarding things like PCIe-Expansions (lanes, electrical slots etc.)
Goal
I’d like to build a local server or workstation to have a decently powerful platform for some AI experiments and “real independence” from the large companies.
Obviously I cannot replace Anthropic, but I want to be able to do some serious work and maybe even provide AI for a small team of researchers, local projects in my community etc.
All this to say, that my endeavor is as much of “philosophical” nature as it is technical.
Budget
The approximate Budget would be about $10.000. However I am based in Europe and in my experience prices can differ widely between the US and the EU so it’s really just a ballpark.
Obviously, if I can get away with spending less I would do that but I don’t wanna compromise too much just to save a few bucks here or there.
Current State of Deliberations
After some days of research I arrived at my current idea of building a system based on the Threadripper platform.
CPU
More specifically I was thinking about the
- Threadripper Pro 7955wx or the
- Threadripper Pro 7965wx
Depending on which one I can get the best deal on.
As I understand it, the CPU is not really the important factor when talking about AI performance but a bit of CPU compute shouldn’t hurt when there might be other tasks to be done. Maybe some protein folding (I remember Folding At Home being a thing during the height of COVID), simulations, etc.
Mainboard
As a mainboard I am currently looking at the
- ASUS PRO WS WRX90E-SAGE SE or the
- ASRock WRX90 WS EVO
I chose these because of the availability of enough PCIe x16 slots (they both have 6 slots at PCIe Gen 5 x16 electrically AND bandwidth wise)
Case
I’m looking at the
- Fractal Define 7 XL Black TG Dark
because so far that’s the only case I could find with enough space for a 4 GPU setup. Which leads neatly in the last main point.
GPU(s)
I am thinking about (ultimately) getting
- 4 AMD Radeon AI Pro r9700
I was looking around a bunch and I also saw Wendell made several videos on it.
There even was a giveaway at some point where people were chosen to receive a rather similar system to what am I planning (as far as I can tell).
I might start with only 2 or 3 and get an additional 1-2 later depending on the market but as far as I can foresee it, prices will go up rather than down at least for the next year or so.
RAM, Storage, Cooler and PSU
Here I would simply take whatever is available and fits the criteria.
- I would start with a smaller amount of RAM for now to keep costs down a little and grab used RAM if & when I spot a good deal
- I would start with any 1TB or 2TB NVME (gen 4 maybe) I can find a good deal on
- I haven’t looked too much into coolers but these days they all seem pretty good to me
- I would get a 1600W or maybe even 2000W PSU (to future proof)
There doesn’t seem to be that much choice for PSUs in that wattage range and RAM is expensive no matter which brand.
Questions, Alternatives
With my plan presented I would like to ask you, the Community, for input.
- Did I miss any important things?
- Do you have some swap in recommendations that are better than what I found so far?
- Are there alternatives I have not mentioned (found) yet?
- I am currently deliberating if I also need a NIC (my home network would also need to be upgraded to use more than 2.5gig networking)
- Am I maybe completely on the wrong path and would be better off with one or more Strix Halo (or comparable hardware) units?
- Are there any prebuilt options that are comparable and fit 4 GPUs. I couldn’t find any and they seem to be much more expensive
One alternative I was looking at thus far was a used Gigabyte G292-Z20 GPU-Server. There are some offers with an EPYC 7452 (or other 7000-series chips) 32gigs DDR4 and PCIe Gen 4 Slots I could get for around $2000.
However, my thinking was that a Threadripper 7000 series based machine would be a little more future proof maybe. Additionally I don’t really have a space for a server rack and am hesitant to just put a “blade” server in my home naked like that. (Not to mention the noise)
I have some experience building PCs myself (my current mini-itx is build in an NCASE M3), so I am not too concerned with the whole DIY aspect.
Thank you for your time and feedback.
Cheers!

