Mini PC - can it AI?

Hello everyone, I’m trying to embark on a new journey and I need some guidance. I’d like to deploy my first Home Assistant instance in my new house since I never got around to do that where I currently live (you get into the groove and don’t want to disturb your own peace) and this big of a change is a good excuse to do so.

I’ve been looking at some mini PCs to deploy the Home Assistant distro a base OS I haven’t chose yet and possibly run Ollama along side it with a tiny model that could make the voice commands and queries a little smarter. I don’t need complex things like spitting facts, just the usual things like polling sensors status, sending commands to devices, set timers and do math I can’t do off the top of my head.

Now the budget for this project is 500$ max and I’ve found some Intel 12th gen and AMD 6xxx computers and my idea was to run Llama3.2 1b at a minimum, 3b would be ideal for my use case.

Do you think there’s enough horse power in one of those machines for my needs?

Thanks!

If it’s got enough ram for the model, it’ll run it… whether it’s fast enough is another story. I haven’t tried that specific integration, but I get a reasonable token rate from a 9th gen i7. I’d be interested in you trying it out on a $500 machine and reporting back… :face_in_clouds:

This topic was automatically closed 273 days after the last reply. New replies are no longer allowed.