Hello, I’m quite new to AI, and would like to run something locally to get more familiar with technology. Hardware-wise I have 14700k with 7900XTX and 96 GB RAM (can expand to 128 GB if needed). What ML may fit better into my hardware limitations? Saw Wendell’s video today and it reignites my interest to a topic. Will be grateful for a gentle push to right direction ![]()
The simplest way to get started is to download LM Studio http://lmstudio.ai
It even suggests models it thinks your system can run well enough
Cheers, I was not aware that LM Studio actually proposing compatible LMs. I will definitely check it out today. Will it potentially an issue that I will need ROCM instead of CUDA? I suppose most of stuff is CUDA optimized?
I believe so, but I’ve not own an AMD card before so I’m unsure what you may experience.
check out AMUSE as well it’s all image and video generation and editing stuff no text generation but it can be fun to start out with and its supposed to be optimized for AMD
Thank you very much. I will check it out for sure!
I would imagine this is what is called a hallucination? ![]()
This is new session with no prior prompt provided.
Can’t install it for some reason
v2025.5.0.rc1 is crashing on building amuse-framework. Will try to check later what is going on
only think I can think of it to update the gpu driver
I played with DeepSeek for some time in ML Studio and I may confess, I really liked it for sorting out different general purpose things.
What may be the possible way to grant him access to Google Search? (Hello, Skynet
) From what I understand it is possible via external systems, though I’m not quite understood what exactly I should use for such thing.
