Budget GPUs for PyTorch in 2025

Hi, I’m looking for some good options for GPUs for training and running my own PyTorch models, not that interested in running LLMs locally.

I currently have a Radeon RX570 in my rig but its no longer supported by ROCm. Seeing as AMD is eager to drop ROCm support for older cards and how it seems to be a dog to get running properly, I’m looking for NVIDIA cards.

Unfortunately I haven’t paid much attention to the GPU market so I have no idea what the best bang-for-buck option is in 2025.

My budget is 400 €, any suggestions?

Thanks!

How much VRAM are you aiming for?

I’m having a look on the Tesla V100 32Gb that, on average, are priced at around 450€. Most from China.

You might want to have a look on the RTX 3080 or the RX 7900 GRE. I believe they are good bang-for-buck, but I’m also starting out my AI journey.

Thanks for the reply. The prices for the RTX3080 are still pretty high at 400 to 500 € considering its a 5 year old card at this point.

Seems like the same situation as the used car market, when new cards don’t go below 1200€, the older models hold their value.

Kinda sucks though.