Which V100 gpu to get

Hi, new guy here!
I have Titan V CEO and trying to get some info about it but cant find anything about them which creates me a problem.
Im trying to pair it with V100 32GB but there are PCIE/ SXM2/3 connects trough pcie so i would like to know which ones to buy as my plan would be to expand 32GB VRAM to 128GB VRAM . Is this possible or im a bit dreaming ?
I was thinking RTX A5000 but i can get only 48GB in total, RTX A6000 - to expensive and V100 32GB cost around 2000-2500 in $ each almost like 1x RTX A6000 for the price of 3 V100`s

I’ve only seen V100s, being either 16 or 32gig

I know, but which ones to buy (32GB) so i can have 128GB VRAM as one. So lets say i want LLM and LLM is 110GB and i want to fit to my VRAM. I need nvlink`s to connect them and have 128GB or im completely misunderstand everything. But when i look at ebay there are V100 PCIE/SXM2/SXM3 - some of SXM2/3 shows non pcie one but some shows PCIE slots and its incorrectly described ? Or i need GV100 32GB ? or i would have possibility to connect only 2 with nvlink ?

I know it isn’t green team, but isn’t cheapest VRAM in 7900XTX?

Kinda late answer, but those are the physical connectors. If you have a Titan V, that means you’re using it on a regular motherboard with regular PCIe slots, so you’d need to get a V100 32gb PCIe version to plug it in.

SXM is an entirely different connector meant for servers.

You don’t! Nvlink sure does speed up things a bit, but you don’t need it. Just slap those 4 GPUs in your system and distribute the model’s layers across those GPUs, and off you go.

1 Like

Sorry for late answer:
Maybe, but as i have nvidia and i dont want to mix architectures, manufacturers ( amd with nvidia ) plus with 5000 nvidia gpu release im hoping voltas will drop in pricing - normal titan v around 700 and v100 starts from 1200 now … so who knows whats going to happen. as 5090 is 32gb as well also a5000 around 700 and 3090 around 500-700 so hoping for the best .

Architecture mixing was fixed back in 2016