Full DeepSeek Q1 with the "IK" version of llama.cpp on AM5 -- No Distills; Just a Quant

Wikis & How-to Guides
45

Per DeepSeek Deep Dive R1 at Home! - #349 by ubergarm

no longer need -DGGML_CUDA_IQK_FORCE_BF16=1

I’ll edit the wiki but thought it’s good to explain the reference.

3 Likes