WIP: Blackwell RTX 6000 Pro / Max-Q Quickie Setup Guide on Ubuntu 24.04 LTS / 25.04

[eousphoros]

I would love to see how this scales with 7 cards

DeepSeek Deep Dive R1 at Home!

Ok final edit, think I have a pretty good max performance bar [llama_results_S_TG] [llama_results_S_PP] For max token/s for prompt processing: parallelism = 1, batch = 8192, u_batch = 2048, threads = 1 For max token/s for model processing: parallelism = 4, batch = 2048, u_batch = 512, threads = 64 Unexpected result for me, the top model pro…

Currently have 2 but was debating on getting more, the more you buy the more you save as the man says.