I find ollama excellent as a framework to run many different models easily locally. Look also into the excellent open-webui:
I find ollama excellent as a framework to run many different models easily locally. Look also into the excellent open-webui: