I just got my hands on a new Threadripper Pro 5955WX and I was rather surprised to see performance in one area fall of a cliff, compared to my old Threadripper 1920X: I tested inference for the Blume language model, both on GPU and CPU. For Bloom 7b1 on CPU, the 1920X finished in 1m 36s 440ms and t…

16 Zen 3 cores SLOWER than 12 Zen 1 Cores?

GigaBusterEXE March 4, 2023, 10:20am 2

you might need to populate certain slots to correctly associate with the chiplets properly

4 Likes