I have a 2 server rack 2 machine homelab ( I got a great deal on the server racks…) running unraid on one machine and proxmox on the other.
Home Assistant, Jellyfin, a couple attempts at Nextcloud… (why is sharing my files in the container has non transparent as I want)
I want to upgrade my local “Smart” things with AI using the XFX 9700 GPU to integrate local AI voice models and a local AI code helper tool. I also have plans for security camera roll out and AI detection as a todo.
I have been using AI coding helpers at work and mostly they suck but one thing they are good at is a rubber ducky that you talk to and helps you understand what you actually want and then if it gives you a useful answer sometimes it is a bonus.
I am curious if with the power of one of these GPUs and a local model if I can get better results more targeted to the actual network and code I am interfacing with.
In summary I have a long term goal of removing “Big Tech” from my personal data and local AI with a powerful GPU like the XFX 9700 would be a helpful part to make that happen.