Thanks! Ive been pouring my tokens into it recently and its been very nice. I think homelab’s in general suffer from potential rot due to not much alerting/log reading as its definitely the most boring part of the job. I also work in cyber in incident response and architecture, so maybe im just a bit paranoid but building an AI SOC/SOAR was a neat idea.
The local AI’s while generally are good at reading and saying something might be wrong, I dont trust them for incident response. The closest they get to it in my setup is a blocklist that propagates to different things. That blocklist had a trial through fire though when it blocked my VPN provider and my WAN address
. Needless to say I have them on a whitelist now, I also exempt RFC1918 too because it got silly one time.
So my advise is, keep it advisory. I have my daily and especially weekly report layout some things to check/verify/cleanup. Anything super critical though the hourly will flag and raise the DEFCON level to critical (from normal or suspicious). If you do have it do any kind of response, it needs to be basic and with some guardrails. Like maybe a service restart, or a machine reboot. Also a sub-agent to verify the finding that is a different model is a good idea. My main model is currently Ornith-1.5-35B-A3B for the “analyst” with web search capabilities. There is an “agent” gets dispatched to confirm and investigate things thats currently on the model Swift-Qwen3.8-27B. its purposely a different more technical model so it can provide a different prospective vs the analyst.
I’m definitely always refining and enhancing this though. Very interested in your project though from a hardware/software lifecycle monitoring perspective. Windows and Linux has great logging facilities for this already, but most of the tools to actually alert for anomalies costs too much money for the low (software) budget homelabers like myself.