Threadripper 7000 Cooling Questions

Hardware Hub Cooling
1

So I was looking a Puget Systems to build this new workstation upgrade I had in mind, but two things struck out to me:

  1. Specific RAM configs available were different leading to the same spec’ed non-PRO TR7000 system to be $1-$2K more

  2. After talking with a rep of theirs they tested air coolers but not the Noctua air cooler made specifically for the TR5/SP6 socket. Which is a big deal for me b/c I would be running 4 of these in a rack that is not alone and (although I know an AIO is rare to leak) I don’t want to have to worry about the water maintenance vs blow some dust and repaste.

So I decided to price out the same build but with an air cooler instead of an AIO. Here is the parts list:

Here are my use cases for these systems/Goals for the Build:
  1. Color Grading in Davinci Resolve
  2. Video/Audio Editing in Premiere Pro
  3. Motion Graphics/Animation in After Effects 99% of the time and Blender 1% of the time
  4. Connect to the server (previous post about that already) to access our footage, render server to push final edits (same with the resolve server we use as a database location)
  5. Only the OS (Windows 10), Media Cache (for PPro and AE), and Proxies will be stores on the m.2s.
  6. Run for the next 5-8 years before I need to upgrade again in 4.5-7 years.
Info I have been informed of that has caused me to post/ask questions:

-TR 7000 is HOT.
-High Capacity RAM modules are HOT.
-Nvidia 4000 cards are HOT.

Here are my questions:

-With six 120mm 3000RPM intake fans, one 140mm 3000RPM exhaust and two 80mm in the fan cage as extra exhaust, will the CPU and GPU have enough air flow within the case to be cool (aka not thermal throttle)?

-Should I be worried about these RAM chips long term? Currently, I run a TR2950x and 128GB RAM and in AE I max out the RAM when in AE (leaving 24GB for non-Adobe apps). Will these DDr5 RAM sticks need dedicated cooling? Or should I be mostly okay? I should mentioned, I’ll be running these 6000 sticks at 5600 (price difference was STAGGERING for the capacity difference over speed ~$1500 for 6000 $3k for 5600).

-If I replace the 140mm fans that come with the CPU cooler with the 3000RPM Noctua’s (in addition to the rest of the cooling mentioned above) would that be some improvement? Noticeable enough it won’t thermal throttle?

-Should I be worried about the VRMS, GPU, CPU, does any component here have a high(er than usual) chance to thermal throttle?

Look I am not asking for definite answers necessarily. I trust not everyone has tried to see what, if anything, could make TR7000 work with an air cooler. But there has to be someone here who is either a) more if not just as air cooling-preferable as I am, b) could confidently access and guesstimate that what I have listed here is overkill or not going to yield the result I am hoping for, or c) has used the CPU cooler, tried this fan config, or tried something similar here and could provide any feedback/their thoughts or results in cooling these components.

TLDR:

Will the build be cool (aka not thermal throttle) for a video editing/color grading/motion graphics workstation?

---->

    WATER COOLING IS NOT AN OPTION
---->
2

bro,
If you’re using it to make money:
Puget Systems all day

else,
build it

4 Likes
3

I haven’t built in this case before, but I see no reason why it shouldn’t work. I ran the same cooler on a freely clocking EPYC 7H12, and it worked without issue in a large tower under my desk. CPU temp was never an issue.

Do I understand it correctly that you are looking to run this in a rack, and not under your desk? Especially if you let the intake fans run at high rpm you shouldn’t have an issue. The airflow from the intake fans should also be good enough for the Ram sticks due to their orientation. If you are super super worried about the airflow to the CPU cooler, then you might want to look into using a cooling duct to direct the air from e.g. 3 intake fans directly onto the CPU cooler, (and the RAM sticks).

4

I’m confused.

  • 7960X is quad channel. TRX50 AI’s an eight DIMM board and the planned config seems to be 8x64.
  • Resolve, Premiere, After, and Blender are, to my understanding, all GPU favorable. But the config’s single 4070.
  • ΔT and LFM estimation seems absent and mediocre to average Noctua parts are selected despite.
  • SM52 intake looks like 3x120, presumably followed by another 3x120 in series here despite lack of obstruction.
  • It’s unclear how mechanical constraints between CPU and DIMM coolers would be addressed.
  • There’s one MP16+ with 85 °C NAND and three Pascals with 70 °C NAND.
  • There’s a 1600 W supply for probably ~700 W system power.

I’d suggest

  • Reconsidering whether the current BOM’s the most effective spend for workload throughput, both within box and against conversions like 1x 7960X + 4070 → 2x 9950X + 7900 XT(X).
  • Using the routine thermal maths to determine chassis airflow and fan requirements.

Ta and ΔT aren’t given but, with common figures and typical 120s, I’d expect 3x120 to come in around 1400 RPM at the chassis level for 700 W. Silverstone’s documentation is cryptic but they seem to show a 420 rad, so 3x140 appears also to be an option. Not that there’s necessarily any noise-normalized gain to 140s but dB(A) doesn’t seem a concern for these builds. If it turns out there’s enough DIMM throttling to break the AIO resistance the RM52’s ready, at least.

5

The TRX50 is a 4 DIMM board. The WRX90 is the 8 DIMM board.

1 Like
6

I second this. Dont build, buy.

7

Hey Twice! Yeah, I usually would hence why I am just going to build it since they were not willing to do anything but watercooling which is what I wanted to avoid. Hence, these questions about cooling as again, I am sure someone has experience with these parts and how they effect Threadripper.

Thank you so much for your reply @Ludger ! Welcome to the forums.

Yes, this will run in a rack. In fact, it it works, 4 will be running in a rack. I appreciate all your thoughts. Your second opinion has been very helpful :slight_smile:

No worries, let me break it down for you :slight_smile:

Same as my 2950x and MSI Creation x399 board. Quad Channel, 8 sticks of 16GB = 128GB RAM. So this config would work just fine as I don’t need eight-channel memory for this, but I do need the capacity for the types of RAM previews we are doing in After Effects while Dynamic linking to PPro, with a browser open, etc. etc. Already maxxing the 128GB I have currently when working hence the upgrade.

Mostly ProRes footage so the CPU and GPU combo should work great according to Puget’s guides and my one-on-one phone call I had with them. Also, Adobe can only utilize 1 GPU effectively so I’m just going to avoid the extra cost it would be for minimal return. Blender and Resolve could benefit but thats lesser of the company workflow.

Please elaborate? What’s wrong? What do you advice?

If I understand you correctly, you’re asking about the case and fan config? It can have 6 x 120mm / 3 x 140mm fans in the front and 1 x 140mm in the rear. Plus 2 x 80mm fans in the rear cage. So no obstructions. I also added 2 additional 140mm fans to replace the Noctua CPU coolers potentially. Hence why I asked in my topic post if it was needed or not. I read on Reddit, a review on some pc parts website (I forget which one), etc. that doing so would help. Wanted other opinions though too. I had confirmed by phone and email Puget did NOT test it with this cooler.

I was under the impression there weren’t any by the measurements I read? Did I miss something?

I have no idea what this mean I am sorry. Please elaborate. Are you saying I have different SSD’s in the system (yes, I am aware of this?)?

PCPartPicker does not have a part in their database for TR 7000 yet, so as you can tell by reading the parts list, I have custom entered Amazon links to such parts. Such parts do NOT get added to the TDP/wattage/resource calculator/etc. Add 350w for the CPU, the motherboard wattage, and the cpu cooler wattage you have over 1000w for the system. I may upgrade down the line so going from a 350w CPU to say a 400w if 8000 is such, I just want safe, effecient headroom (and still adhere to 80% draw from the wall. Although this will go to a UPS first).

I need the increase in RAM which is where this mostly derives from. Again I am maxing my current 128GB. Not going AMD because adobe has shown to prefer CUDA acceleration. I’ll only use AMD GPU’s for budget gaming or budget GPU but never work simply due to that fact. The config is fine for what I would need in a system, I am more concerns can I cool the darn thing, lol!

You’ve got a calculator or something for that? I have no idea the formula for that.

Alot of info, thank you so much @lemma

Why exactly? Its half the price, I’ve done this before (albeit not TR 7000 but previous TR builds) and I don’t want water cooling. Simple as that. I’d need a bit more info that just “don’t.” As far as cooling goes, is this going to be poor and thermal throttle way too much? Or will it be fine? That’s really all I am asking right now. But I appreciate it :slight_smile: @LinuxNoob1

2 Likes
8

Because numerous people have had monumental issues building a threadripper 7000 system themselves. I don’t know about you but If I am using a machine to make money, I don’t want to spend months messing with it as it crashes, doesnt boot, waiting for RMAs, RAM over heats, and on and on. I just want it to work out of the box. If you want a rock solid system that will work, forever, go with Puget Systems. I guarantee if they sell you a system with an AIO, that AIO will work flawlessly for years or they would not sell it.

9

TRX50 has 4 DIMM slots for 4 channels of Registered DDR5 ram, not DDR4 or DDR3. WRX90 has 8 dimm slots for 8 channels of DDR5 Registered Error Correcting RAM.

10

FWIW : I have an air cooled 7970x with an air cooled 4090 and have no issues whatsoever. I have one extra fan to help cool the ram (which is a concern if its overclocked), but I honesty think you are over thinking this. Its not that serious.

11

So I am up and cant sleep and I noticed that PugetSystems has some specs listed for the Asetek cooler they use. The MTTF or Mean Time To Failure is >150,000 hours. Or to put that into easier to understand terms, that’s running 24/7 for 17+ years…

You’ll be fine, the cooler should not be a concern. The reliability and uptime should be. That’s what you get when you buy from someone like PugetSystems. A Rock solid system that works.

12

7960x + 7900xt + RTX 4000 here, 780W from the wall during Resolve renders.

1 Like
13

That’s actually as really good reason I was unaware of. I knew it was a thing but not as large of a problem. What tends to be the biggest contributor(s) so far? Bad MB, RAM? I basically copied Puget Systems parts list, just changes the case, fans, MB (asus → Gigabyte) so I could put 8 sticks of 64GB instead of 4 of 128GB and the Power supply brand (Super flower → Be quiet).

I’m avoiding watercooling like the plaque.

The MB I choose has 8 DIMM slots for RDDR5. So again, I say it should work if I put 8 sticks in as I have done this before with DDR4. Sounds foolish if I can’t populate all 8 DIMM slots like I did with my current setup even though both CPUs only support Quad Channel.

Rather be safe than sorry. Most of the build I do I would not worry but with all the headaches I have heard about I just wanted to make sure.

Thank you though for informing me of your experience :slight_smile:

Again, I prefer to stay away from watercooling in my rack COMPLETELY. Hence this build. Plus for nearly half the price I don’t think its a bad trade off.

I copied Puget Systems part list which has a 1600w power supply from Superflower. I choose a Bequiet model instead. Is there going to be a problem between a 1600w and a 1000w power supply?

Thank you you everyone for your thoughts so far, I think I have a good idea on what to do.

14

This isn’t how the TRX50 AI Top motherboard works, if you install a non-pro threadripper, only 4 of the slots will work; the other 4 will be dead unless you upgrade to the pro threadripper series.

2DPC is getting rarer and rarer these days, and when it is offered significant performance penalties often accompany it.

1 Like
15

Thank you, I confirmed in the manual. It was in the FINE PRINT! Thats dumb to me honestly. You should be able to fully populate every DIMM slot on a MB.

I switched it to the same MB Puget is using. I’ll have to figure out the RAM now as sources 4 x 128GB sticks for reasonable (~$3k) is more difficult than I thought, lol. Honestly, not surprising, just not something I thought I’d deal with.

I don’t know what this is. Please explain?

16

I think most people have layed it out. If its just one machine and yours. Build and maintain it yourself. Cheaper and faster support if its your own PC.

I have a lot of respect built up in Puget Systems and thier testin over the years. If I was local to them I would use them as a vendor. Then there are all the business relationships and scaling you can leverage. They do build to order for business’s.

17

I would agree and I am so thankful for all the insights people provided!! :slight_smile:

Oh, I absolutely agree. I view Puget as the leading authority on the matter.

My only issues have already been voiced so to be more succinct:

  1. They did custom testing for me and informed me that air cooling overheated in under 15 minutes. However, they did tell me they would not be testing it with the Noctua Air Cooler MADE for TR 7000.

  2. I am not local to them, in fact I am, ironically, at the furthest shipping location possible within the USA. ~$5000 (ground) shipping alone, lol.

  3. I do not want water cooling in my server rack under ANY CONDITION.

Therefore, in my opinion, $8000 in savings, a fully air cooled system, with no reduction in spec or alteration in parts is worth the time to fix any issues, deal with problems or RMA, etc.

Thank you to everyone who was willing to inform me of their thoughts. As always it is a pleasure and thank you so much for your thoughts.

Any more TR 7000 cooling experiences/thoughts/feedback and/or thoughts of any kind are always, and will continue to always be, most welcome! :slight_smile:

18

Disclaimer: I see your all caps above re no water, then you did say “any more [XP is] welcome”

FYI: If you decide to build it yourself and you change your mind about liquid cooling, I had excellent results on TR with this CPU cooler: Silverstone XE360-TR5 cooler for AMD socket sTR5/SP6

You can see my thermal charts here Solved: WRX90E-SAGE SE trouble POSTing with more than 4 GPUs - #9 by Jackc

I mention because the pump is located in the radiator (which you could mount externally) so the profile on the CPU is extremely small.

Note: I have had a liquid cooler pump leak and fry a mobo, but this config may lower the risk.

1 Like
19

If I can also add one further point to the thread, I can also highly recommend AlphaCool’s 4U server case. It is marketed as for water-cooling, but has all the variability to also be operated as an Airflow-only case:

20

If you want lots of RAM Threadripper PRO or Xeon-W is actually cheaper (more than 256GB)

That makes a lot of sense, unless you are terrified of touching hardware building it yourself has customization + cost advantages

So long as you have enough air current it is fine, most problems of throttling are from people putting no airflow on those components

2DPC = 2 Dimms Per Channel