docker for mac and windows now come with minikube embedded!!! i moved everyone to that as here all devs use MBP´s
i used Kops in AWS for a long time until we migrated to GCP (cheaper and the managed k8s is awesome, also RBAC is integrated into IAM which is amazing)
i think EKS is subpar compared to the GCP k8s offering.
i have a small ansible role that uses the k8s_raw module that setups minikube to works very similar to prod so devs can do everything there. no docker compose and they all got so familiar with k8s resources that is now pretty nice seeing them how to optimize deployments without us (devops involved) everything started going a lot smoother since we did that.
we also use ansible with k8s_raw + AWX to deploy to prod.
Let’s start a different thread about k8s - I’m a big fan and lots to talk about.
Meanwhile, I think I’m going to go ahead and start ordering the parts list above. Maybe waiting to get the AIO and fans last, mostly on the small chance it looks like a 280 could fit, don’t think the 2950x needs it, but if it can fit then why not?
Any further suggestions on parts I should consider or swap?
are you going to be running this 24x7[quote=“derekv, post:22, topic:143334”]
Any further suggestions on parts I should consider or swap?
[/quote]
are you going to be running this 24x7? if the answer is no go for non ECC faster ram.
im building a TR build with the 2990wx and the asus zenith extreme (non alpha)
the zenith extreme is amazing, i have not finished the build but looking at the mobo and the features is amazing.
i went with 128GB of corsair 3200 i bought trough a friend and employee discount for 450 euros. as this is a workstation for me and i wont be running 24x7 rebooting is a non issue for me. i see no benefit what so ever going ECC.
i dont think you will need 1000w PSU even for grow, but one of the things it will give you is that you will be able to run it at its sweet spot and keep it cooler, i went with a 1200w mostly because im trying to keep noise down, i guess the fan will barely spin with my usage.
it also looks like you can put fans on bottom and front of the case, maybe consider that to keep the other componets cooler (mobo and gpu)?
I’m on the fence about the ECC. I tend to leave it running 24 but rebooting is not a huge deal, just a preference. I have gotten ECC for workstation builds in the past but always wondered if it was doing anything for me or not.
I don’t have a lot of time but if you and @lacion want to do something interesting I have two 32 core threadripper machines with 64gb ram I can wipe and setup with ~1tb of local flash and maybe up to ~8tb spinning rust if you want to do a write up or step by step for k8s, I will turn it into a video with props to you guys and links back here.
I am not necessarily talking about k8s on bare metal – a few k8s VMs on KVM on linux would be fine. The networking part is a bit tricky, but both of these machines have 1 10 gig adapter and dual 1 gig adapters, and I can add more PCIe nics.
One thing I DO like about bare metal k8s is that I can give them access to GPUs like the v100s to do jobs that can be gpu accelerated. But I am thinking about maybe showing how you can use basically the same k8s cluster with ngress or something for both dev and production workflow.
git push remote master > k8s vm to check/link/composer install/whatever > new k8s VM pool and/or rsync changes to other pods or w/e.
I like this because mixed workflows are more possible. Up till now I’ve been struggling with some projects where the other people are really just awful terrible people that make their own lives easier at the cost of making everyone else miserable… and this new setup I’ve been working on means I can do my own thing in the k8s cluster then just use ssh to force-clobber things the way they need to be … no developers have to get their hands dirty in the terribleness outside our walls in other words…
But I’d love your insights/perspectives/etc on that because I think the context of my experience is a more narrow use case and I hadn’t considered k8s on bare metal till now.
write up something ro me, or give me some guidance, and I’ll try to build it.
64c/128t on two machines would make a pretty decent k8s cluster probably with some HA? (I could run the controller on another machine if need be lol)
I am building a 2990wx, gonna be oced and on water with 820mm of rad, will 128 GB of Corsair Dominator 3000mhz be comparable to the gskill TR kit at 2966???