My dad is interested in getting into local LLMs. I initially pitched him the framework pc as it was very portable and great for AI models, but we found out it wouldn’t ship until Q3. While visiting him recently, I decided to stop by Microcenter to pick up a motherboard, GPU, case, cpu cooler, and a PSU to pair with my old 2700X CPU and ddr4 RAM.
The 7900 xt size is perfect for this case. My brother’s 7800xt hell hound just barely fit and required frame gymnastics
Note: if you plan on installing a gpu, be ready to unscrew the transport locks and pcie riser card. Having the case like this makes it a lot easier to screw the locks back on at the bottom
debugging this was especially annoying. I thought it was because nix had issues installing the gpu drivers. Turns out I need a boot kernel modification
I’m no expert with linux, I just know how to ask search engines and chatgpt how to fix problems. Debugging and solving this was a massive pain in the ass. I had a unique set of hardware and nix configuration with a problem no one reported
If this was my first time using linux without any cli or debugging experience, I probably would have given up on Nix and gone back to windows.