Long short of it, with tarriffs on the horizon and my desire to play more with LLMs, I decided to get a RTX 5060ti 16gb when I had the chance as nothing else NVIDIA wise was either in stock or in a price range I wanted.
I cannot get it running on my Pop OS VM that my 3060 12gb has been on for a few months. I’m not sure if it’s possible to use the 5060 for AI stuff right now as most of the complaints around it on linux seems to be finicky gaming performance and graphics issues.
I’m willing to try any distro or windows to use it, but are there any guides I should be looking at for specifically AI use?
I’m also worried it might be hardware issues as my server is quite old at this time. I have an EPYC 7302p on a Super Micro H11SSL-i. I was considering “upgrading” to a Ryzen 9 5900 and a gamer motherboard. Or maybe a AM5 platform, but I chose to get the GPU instead. I’ll admit, priorities might have been off as I already had a 3060 and a 4060 running fine in this thing.
Any thoughts?
What is the nvidia module version? You should at least have a 570.* version for 5000-series support:
cat /sys/module/nvidia/version
570.144
You say you’re using a VM - is that with PCI-passthrough to the VM?
Did you update the PCI address or device ID in the VFIO parameter, depending on how you’re passing it?
Does it show up in lspci in either the host or VM?
2 Likes
So running that does get me the 570 result
nags@arty:~$ cat /sys/module/nvidia/version
570.133.07
And lspci shows my nvidia card
00:11.0 VGA compatible controller: NVIDIA Corporation Device 2d04 (rev a1)
00:11.1 Audio device: NVIDIA Corporation Device 22eb (rev a1)
Intersting to note is that my 3060 shows up labelled as a 3060 and not as vaguely as a 5060ti is.
I have not been putting anything in the vfio.conf file because it’s been working fine anyways and they do show up in the VM. I was using Craft computing’s guide to do PCI passthrough.
Proxmox 8.0 - PCIe Passthrough Tutorial
I purged all nvidia 470 drivers from Pop OS again and then installed the 570 drivers from the pop shop, update/upgrade and reboots to the options I have supplied.
Is there another Passthrough guide I need to try? Jeff did mention it might just not work sometimes which sucks.