Sorry, yeah I know it is quite complex.
Running LLMs headless is something I considered some weeks ago when I was trying to work out the best use of resources. I really would like to make full use of the 2 x 3090s for everything, whether one is just providing display to VM1 which will be my daily driver, or both are assigned to the same VM because I want to use them to load an LLM or for some other intensive task or ML, or one is temporarily assigned to the Windows VM2 for gaming.
I should make clear I do not expect to be perform any resource intensive AI tasks while gaming, but I do want to be able to seamlessly at a glance to my second monitor or through a key combination switch between VM1, VM2, and VM3.
Can I assume that in the same operation where I move 1 3090 from VM1 to VM2 for gaming I can just as easily remove the 275W power limit so that the Ti version is not negated? Shame about RT, if I was just building for gaming I would go for a single used 4090 but alas VRAM. Getting a good deal in the used EU market is not easy but if I can get 1 or 2 Ti versions I will. If the market is really bad I could import from the US and pay customs.
I had assumed that when using a flagship CPU like the 9950X3D in a board, that where the PCie lanes and speeds are enough to support the GPUs that would be enough but please tell me about the other calculations.
I am aware of Threadripper but I really want to stick with a single AM5 for X3D though when I thought I may need 3 GPUs I was considering a fallback of dropping VM3 (trading) to run on a light MiniPC. From the discussion in the other thread and what you have said I should still be able to manage 3 VMs running simultaneously with just 2 GPUs and the iGPU?
Right now I am considering the Asrock Taichi Carrara x670e as apparently is provides adequate spacing for the GPUs, ease of use with VFIO, and great IOMMU groups, but if something like the Tacihi Lite b650 other than 2 x PCIe 5.0 has the same benefits I am happy to save money with it.
Yeah I am aware of this, but right now separate to how native linux gaming support has really come on in recent years if something requires Windows I do not reboot into it because I want access to everything else in linux, so VFIO will be a big upgrade to my experience - even if many games have anticheat issues.
Edit: I guess block diagrams like this for the Asrock x670e Taichi is what you are suggesting I consider in terms of lanes:
