This is awesome info, thanks! I can’t remember from your other thread whether you tried to run the version of the 671b model from the ollama model library, or if it was too big to attempt to run from NVME.
2 Likes