I’m not really sure if I’d end up with the 9700 in my main desktop alongside my 3090 (CUDA + ROCm sounds a bit messy), or if I’d end up moving it into my 2nd desktop solely for inference, but I guess I’d need to try it out in order to find out.
One thing that I’m certain is that the extra VRAM would be really welcome.