Best "AI" chat bot to run on a Lunix system for local networks, with adaptive learning

Greetings!

I hope all that participate had a good thanksgiving and are not bloodied in a ditch outside a Best Buy right now in hopes of getting a TV or something…and if you took any damage it was at least at a Micro Center…and you got lucky!(like some DDR5 under $500, lol).

Anyway, I am wanting to build a chat bot for my home assistant/automation setup Im expanding. I have been leaning towards Rasa, but I have little exp with this, so far, so I wanted to reach out to a higher quaility hivemind to get some good input before potentially wasting any time.

I would like it to be able to learn as it goes based on interactions and “data retrieval”. As well as have multible “faces” for different people if possible (like one for my kids, one for guests, and then one for me with more permissions than the others). I would also like it to be able to control HA, “CCTV” feeds, and some other custom automation, with it eventually. I dont want it to have direct internet access(the network it will be on is 100% offline, not a VLAN), so it would great if I can have it refer to my offline data/reference material and what it has encountered in the past. Another big feature I would really like it to have is the ability to migrate it to another host system easily, without losing any training it has aquired, when it comes time to upgrade. The ability to communicate with it via both typing and speach, is ideal, too. I have a feeling that is pretty standard, though, based on what I have learned so far.

Thats all of my main atributes that I would like it to have. It would be nice if it doesnt need a very hefty system to run, too, though. I dont mind building a “mid” system for it, but the lower the resources needed, the better. Speed is not as much of a concern as functionality. I assume there are trade offs between quaility/functionality and system “power”, so if I need to spend a little money to get it to do what I want, I can get over that.

Im diving right in here. Im technically a newb with Lunix, imo(only been using it lightly for a few years, then just switched 100% from windows, due to gaming holding me back, in Sept), Im happy with it). I have been building PCs for like 30 years now, though, and do a lot of “hardware hacking”. I have been repairing older PCBs and CRTs(mostly Aracde) for about 20 years, and build new devices/gizmos from scratch. Not bragging, just trying to provide an idea of my level of understanding in case a siggestion may need more exp.

Ok, thats it, I think…i appreciate everyone that took the time to read this, and will be very greatful for any input y’all may have to offer.

Cheers! :grin:

1 Like

I have been looking for the same thing. I have used CHAT quite a bit, but every new rollout nerfs the model quite a bit, to the point that it sounds like you’re ‘chatting’ with a progressive LA lawyer most of the time. I’ve tried a few offline models, but they’re all infested with insane safety wrappers. I understand not wanting people creating monsters in the woods, basic safety measures make sense, but I don’t need it telling me “you cannot remove a smoke detector, that will invalidate your insurance and cause liabilities” when asking about fog machines…anyway, will follow with interest. I haven’t done a linux build, but as I won’t upgrade to win 11 for any reason, and my locked down win 10 build is showing its age, it’s inevitable.

1 Like

Thanks Mr. Pants!

Isnt it amazing how a computer that was running Windows 10 or an older MacOS version just fine years ago, now struggles to do basic stuff running the same OS?! Apple is by far the worse, at least with battery devices, not that they dont pull things like that everywhere else they can, too, I mean they are the worst when it comes to the OS starting to run like…well, you know. On top of the normal nerfing to encourage “upgrade”(aka “buy new overpriced hardware, then repeat”), the stuff they do to make battery life and longevity seem better than it is(throttling CPU, etc) just makes me so mad. Its a stupid mad, I dont use their hardware unless it is free or extremely cheap. At which point, I just install Lunix. However, that isnt always so cut and dry, I believe they have booby traps, too, intentional or not. I wont get into all that, though. Anyway, same thing happened with 10. If they are going to change the OS that much via updates, they need to make that more clear to people. I get security updates, but the non stop adding of bloat and whatever is going on to make a PC that ran 10 nice and snappy, lag for mins on the simpliest thing, even on a brand new install. I guess its the violation of principal imo that gets me so erked about such things. Its so rude!

Anyway, sorry, “Digress” is my middle name, and brevity often escapes me in text communications. Thanks for that input! I had not actually considered such potential annoyances. Like you kinda said, not because I want to do bad things with it, just that their ability to determine the actual risk of something is lacking in general, so errors on what IT sees as caution, often meaning denial. Even deployed commercial systems do that crap. I had a self check out at a “Super Market” call the loss prevention people over, which stopped my ability to check out for a while, as there were lots of people behind me because it didnt know how much a brick of TP weighed. It showed me video of me scanning it and putting it on the bagging scale as “proof” I was stealing something. It(SHOULD HAVE) known that it was TP, since I did scan it, and it saw it on video. How hard it it to ID that for even a simple “AI”?!(I know my $45 husky lens could with MINIMAL training, this thing prob cost 5+ figires! Oh yeah, like I said, I didnt hit “skip bagging” or put it in the wrong spot, I sat it on the scale, but it refused to beleive that, held up the line for a while, and accused their customer of being a theif. All for what? I stopped going there completley. Even if I had stolen that TP…and did every month or so, they will still have made more off me than they lost in TP, but now I will never go back. Im stubborn when it comes to my principals. I just dont see the point of having them, if not to live by them, I guess.

Geesh, see, I warned ya, lol. I will keep that concern in mind going forward, I would hate that! As well as a version that is going to be getting a lot of updates may not be ideal. Or I may want to consider findinh one that works as I like it now, then not updating since its offline. Or.better yet, one known for not nerfing or breaking bots via updates. I should prob figure out a good backup scheme, too. You gave me a lot to think about, I appreciate it!

Cheers!

1 Like

Best part about starting a thread: Nobody can b*tch at you for crapping all over it. I too tend to meander and digress, from time to time.

We checked out of the “cattle troughs” as I call them completely. We went offgrid-ish, I don’t give big box stores any business, and do my best to not order online. I go to the smallest local shops I can find for everything I can, even though it costs more in the long run. The way I see it, that extra bit of $ I spend is the tip to retain my humanity and my soul. Society as we know it is dying. Everyone can see it, but they can’t figure out why, or how to fix it. There is no fixing it, parallel society is the only path I see forward, so I packed up the entire damn family, bought a mountain and never looked back. The pandemic opened my eyes to a whole lot of things, we spent 50 years in the “big city”, so it’s not like I’m unfamiliar with exactly the kind of nonsense you are describing, but competent people no longer get jobs, they are lowest common denominator positions at supermarkets and whatnot. Society exiled the ones that produce, the ones that work hard, the ones that paid the bills. Those that could, have already fled the cities, you’re seeing the fallout of that in every company and corporation today. It’s the inversion of reality, where the people who do nothing, tell the people who do everything that they are ists, phobes, boomers and whatnot. So we quit. Got my kinds into the trades, because business school just isn’t worth the money you spend on it anymore…but I digress…

Heh, I can likely challenge you to a divergent ramble text challenge, nobody rambles off topic like I do. Cheers fella! :wink:

1 Like

Dude, are you like a clone of myself or am I a clone of you?!..I think you may have a few years on me. I couldnt have said that better myself!!! I have NEVER heard anyone else use the term “parallel society” or as I say it “parallel economy”, before! I have been advocating for that for many years. I think people should be able to chase wealth if they want, but not at the expense of others without means to resist or to an obscene level. However, if people would rather not participate in a rat race, and say just help people, they should be able to do so without being destitute. Although, as I write this I think you meant more like “the outskirts of society”. Still, Im right there with ya, although, I still often consider how to fix this mess, even though Im pretty sure you are right that it cant be. Unfortunately, “impossible” is not a word my brain likes to give into, so it will obbsess about it as a background process…it does hog resources usually, and can be a pain, but I cant really help it. I guess I feel if I can understand, others can too. The problem is as you said ALL institutions are staffed by incompetence from the top down at this point(*see; “The Prince” as to why). Displaying any kind of critical thought, compassion, or competence is seen as a threat to such people/companies and is a sure fire way to be a target. I have literally lost my position as a one of the main supervisors at a company for following the training and common decency by bringing up a manager sexually harrassing my team members. Apprently, I was supposed to gas light them into thinking it didnt happen and fire them if that didnt work. They did it for me and then the guy beat up a security gaurd and went to a female employee’s house and threw cat poo at her before tearing up her yard with his truck…they let him resign. Anyway, point is, I have no place in that “world”. I wasted so much of my oldest’s life trying to play that game and regret it sorely. That is why, when the pandemic started I also left the “city” and moved to a farm the middle of a State Forest. I was VERY lucky because I couldnt afford to do that without being paid to take care of the place. When Im not caring for the farm, I am working on my reforestation efforts and the removal of invasive/aggressive native plants that were choking out the trees. Its amazing how much healthier the woods are now! I think we may have met our equals in eachother in regards to our digression capabilities, lol.

I have made my expenses extremely low and work for money as seldomly as possible. It gives me a lot more time with my kids and keeps me from adding to the problem. I buy used/broken most of the time and repair anything that breaks, myself. Between my neighbors’ farms and mine, 95% of what we eat is local and organic…and cheaper for me than any store. I can trade a few hours of work for as much food as a few days of a good wage could afford. I will.pay more for things if they are worth it, too, though. I am not a fan of junk. Thats why I buy used older stuff that will last and can be repaired. I will also GLADLY pay more to make sure that money stays local and 50%+ doesnt end up in a tax haven hoard…I mean bank. I will also buy new PC hardware, but I tend to get the last gen’s high end. Mainly because the drivers etc are dialed in, but also because of cost. Its been a long time since I have built a full new high end PC. Its rarley worth it in my exp. It is pretty crazy that if like 30% more people lived the way I do…and the way you do apparently, our economy would fall apart in no time.

Anyway, I will stop here for now. I havent got what I am looking for with this post yet, but if interacting with you is all it yeilds, Im cool with that! I rarley come into contact with people that dont think Im crazy…or lazy for living the way I do, so it is a really nice change. Even though I am confident in my reasoning, one can not help but question themselves, or at least they should from time to time, imo. Its helpful to hear what I think from another to get some “you are prob not crazy” support, lol.

Stay free brother!

1 Like

If you haven’t done so, and know that it’s legitimacy is hotly debated…look into the enneagram scale. I am a “self preservation Eight”, and you likely are too. It sort of helps to define what your “box” type is, where you are on the health scale of it (Eights are either leaders or dictators, depending on the place in the scale…
Our societies have risen and crashed so many times over the millenia, I do believe that this is just the downward swing of this one. I believe it will splinter, fall apart and tribalize, likely with a good bit of war and upheaval. I had NO intention of moving to the middle of nowhere, I was retired at 50, set up for life, the whole bit. I sold all the properties I had bought and renovated over the years at the peak of the market, and bought acreage. It was an overwhelming urge to “get out, NOW”. I believe you may have picked up on the exact same patterns that I did (it’s not magic or spirituality). I assume you are good at “judging” people, and perhaps just scratching your head when you see people acting insane but pretending it’s normal? It’s because you SEE the world as it is, the scaffolding, the ebbs and flows, and you too felt that the woods was a place where you could get some silence and try and figure out what was going on? Well you saw the same things that I did, like other “pattern recognizers” did, and why there was such a MASSIVE demographic shift/migration out of cities during the past 5 years. Cities will continue to die, until only the parasites inhabit them, and then they fall. Those that cannot survive outside the support systems will perish…it’s actually fairly grim if you really start tracking the decline. I take no enjoyment in any of it, I liked living in the city, I liked our society, but look at it today.

I am slowly putting together the pieces for an offline LLM, but the processors aren’t quite there yet (and I don’t want to spend $100,000 on video cards). As well, the LLM models are crippled to the point of uselessness as far as I can tell, but the ultimate goal is to get an offline (trained) model that can’t be reprogrammed by the corporations. So that’s why your post caught my attention, then I saw that you were a fellow signaller. You might just not know it. We’re the ones that will work towards whatever comes next… now I’m not at all the type to tell anyone else what to do, but I’d say it’s best to stop worrying about the dying society, and put more effort into the future. Make alliances with people (farmers, ranchers), they wield a lot of power in rural frameworks, and they’re the ones who will feed us when the cities stop functioning. Trade, barter and usefull skills are your friends. Food, fuel water and salt, those are key. I’m no prepper… well I never think of myself as one, but I’ve slowly been setting up supply lines out here, I have meat from a rancher, plus permission to hunt on ranch land, I get wood from a farmer that also works for forestry clearing deadfall, so that I’m not clearcutting my own part of the forest. I stockpile bullets, weapons, alcohol, gold and silver…anything that can be traded if/when people realize the banking system is broken (most banks carry 0% cash reserves now…meaning all money is just numbers of a screen. I know I sound crazy to normies, but they aren’t the ones I’m signaling too, it’s guys like you, and others like us, that “see” what is really happening, even if we don’t fully believe it yet.

Now that said, I 100% want to be “one of the good guys” in the new reality. I want to help people remember why the old system failed, like so many before it. We have unprecedented access to communication, like never before. This time when the “modern world” falls apart, everyone in the future should be able to point out the culprits, and set rules to ensure it never happens again…but those only last until the next thing is running on autopilot, and falls apart too. It’s a never-ending cycle, but as long as humanity survives and moves forward, it’s all worth it.

Well met fellow pattern recognizer, welcome to the crazy club. It only gets weirder from here, so try to have fun with it…it might be grim, but life is still a whole lotta fun. :grin: