I soon got two NEC VectorEngines and am looking for an appropiate machine to put them in. I already made all the fun decisions and am now just left with the boring stuff. PSU and storage.
I have no idea what i would want for storage with this. So far i never had more then 500GB in a PC at a time. Due to my platform PCIE 4.0 storage doesn’t make any sense.
I am open to used options for power supplies if that makes sense. A multi PSU setup or something similarily wild would also be possible. I trust myself with an continuity checker not install things wrongly.
I doubt i ever use the CPU at full tilt, the two VectorEngines at full tilt and the GPU in a compute or AI workload at full tilt. However should such a load ever occour the PSU shouldn’t die or damage components. Electricity prices can be assumed to be 30-33+1/3 Cent/kWh. Arguements for higher priced PSUs based on power savings are possible if the math works out.
I am looking for a few options that make sense as i am frankly lost with the rest of my build. If anyone has other suggestions for things you would like to see in the build. Budget options are very appreciated. The budget doesn’t need to be spent. First time poster. I also made a post at Help pick storage, PSU and misc for NEC VectorEngine host&streaming PC - New Builds and Planning - Linus Tech Tips
For misc stuff i have no idea what i am missing. Suggestion are welcome. Mouse, keyboard, webcam and monitors are taken care of.
Budget (including currency): <400€
Country: Germany
Games, programs or workloads that it will be used for:
- some stable diffusion like stuff on GPU
- being a public playbed for NEC VectorEngines
- streaming some coding
- streaming some non demanding games
- Running two full HD displays which at best do 60Hz
Already owned:
- Two NEC SX-Aurora Tsubasa VE10C which is a two slot height 16x PCIE 3.0 accelerator card with 1 EPS-12V 8 pin power input.
The actual power draw of such a card under peak load is not known and i don’t have a peak workload yet that stresses all the units. At the bottomn of the post i discuss what i know and measured so far on one card. VE cards can be powered down and spun up quickly (~5 secs) into offline state for lower power consumption.
-
Two 2x 8pin PCI-E to 1 EPS-12V 8 pin converter meant for A6000 GPUs from NVIDIA which also uses 1 EPS-12V 8 pin.
-
One 16x PCIe3.0 extension cable
I am upgrading from a Fujitsu PRIMERGY TX140 S2 workstation. I guess that comes with a Fujitsu TFM MODUL F/ FBU OPTION 6 Gbit/s PCIe 2.0 RAID 0/1/5/6 2x SSF-8087 8x ports int. and a 8x 2.5" hdd bay although i would have to 3d print some Fujitsu HDD Caddies and am not sure there is space in the new case for it.
Just bought. Parts which are known to be working together:
pcpartpicker com list yZM8TY
AMD Threadripper 1950X 3.4 GHz 16-Core Processor
Enermax LIQTECH TR4 280 80.71 CFM Liquid CPU Cooler
Asus ROG Strix X399-E Gaming EATX sTR4 Motherboard
ZOTAC GAMING GeForce RTX 2080 SUPER AMP
Corsair Vengeance LPX 16 GB (4 x 4 GB) DDR4-2666 CL15 Memory
Fractal Design Define R6 Blackout ATX Mid Tower Case (has an vertrical 2-slot not modeled by PC part picker)
The most i know about the power consumption of the VectorEngine card
The faster models which are water cooled and high clocker or externally air cooled have twice as much HBM2 memory and are also running one a single 12V-EPS connector. All those card have an power consumption of “less than 300W”. See Installation specifications Hot Chips slides
This is the most precise information by NEC i am aware off.
Measurements:
A card going full tilt doing double precision floating point matrix mulitplies not touching integer units reports:
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 69.6°C 68.9°C 72.4°C 69.8°C 69.6°C 71.1°C 68.9°C 70.9°C
└ Power: 181.7W (AUX: 12.1V, 13.9A Edge: 12.1V, 0.8A)
└───────────────────────────────────────────────────────────────────────────────┘
A card doing an integer heavy workload which doesn’t touch floating point units at all:
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 64.6°C 64.1°C 66.2°C 64.8°C 64.6°C 65.5°C 64.0°C 65.4°C
└ Power: 135.2W (AUX: 12.1V, 10.0A Edge: 12.1V, 0.7A)
└───────────────────────────────────────────────────────────────────────────────┘
DAXPY nearly all the memory once with all 8 cores in a really bursty workload, so temps didn’t pick up yet.
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 48.9°C 48.4°C 49.5°C 48.8°C 48.0°C 48.5°C 47.8°C 48.4°C
└ Power: 141.9W (AUX: 12.1V, 9.0A Edge: 12.1V, 2.3A)
└───────────────────────────────────────────────────────────────────────────────┘
An idle card reports:
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 50.1°C 49.6°C 50.2°C 49.9°C 49.9°C 50.1°C 49.6°C 49.8°C
└ Power: 45.0W (AUX: 12.2V, 2.9A Edge: 12.1V, 0.4A)
└───────────────────────────────────────────────────────────────────────────────┘
An idle card at 65 degrees reports:
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 64.4°C 64.0°C 66.0°C 64.5°C 64.4°C 65.4°C 64.1°C 61.6°C
└ Power: 54.8W (AUX: 12.2V, 3.4A Edge: 12.1V, 0.7A)
└───────────────────────────────────────────────────────────────────────────────┘
Selfreported but dubious power consumption in offline state:
┌── #0 NEC SX-Aurora Tsubasa VE10C ────────────────────────────────────────────┐
┌ Physical: 0.0
├ AVEO: 0.0
├ Clock: current: 1400 MHz, base: 800 MHz, memory: 1600 MHz
├ Firmware: 5395
├ Memory: 24576 MiB
├ Cache: LLC: 16384kB, L2: 256kB, L1d: 32kB, L1i: 32kB
├ Temp: 0.0°C 0.0°C 0.0°C 0.0°C 0.0°C 0.0°C 0.0°C 0.0°C
└ Power: 5.0W (AUX: 0.0V, 0.0A Edge: 0.0V, 0.0A)
└───────────────────────────────────────────────────────────────────────────────┘
I made my purchasing decision based advice on other platforms.
Bought used as a set: 750€ + 33,61€ platform fees.
- AMD Threadripper 1950X 3.4 GHz 16-Core Processor
- Enermax LIQTECH TR4 280 80.71 CFM Liquid CPU Cooler
- Asus ROG Strix X399-E Gaming EATX sTR4 Motherboard
- ZOTAC GAMING GeForce RTX 2080 SUPER AMP
- Corsair Vengeance LPX 16 GB (4 x 4 GB) DDR4-2666 CL15 Memory
- Fractal Design Define R6 Blackout ATX Mid Tower Case (has an vertrical 2-slot not modeled by PC part picker)
Bought new and asked advice for:
-
178,90€ Thermaltake Toughpower GF3 TT Premium 1350 W 80+ Gold
-
102.70€ Transcend SSD 220S
-
5,95€ shipping
287,55€ subtotal
Total spend for computer:
1.071,16€
Feedback is appreciated