So, I came back to necro my own thread, as I’m much closer to being able to afford the server.
After looking over all of my options, it turns out that bifurcation just won’t work out (I couldn’t find a platform supporting enough PCIe slots and bifurcation at the same time withing my budget). So, my primary storage will be 2.5" SATA drives.
Software stack
This has been, more or less, decided.
Host OS - Proxmox
Two reasons:
- first class LXC support
- native ZFS
As for Docker, I actively do not want it on the host - had some issues with it mucking with iptables, so I’ll throw it into LXC or a VM.
file sharing - TBD
What I want is not a full NAS distro (like TrueNAS), but rather a share management solution I can run in a container. Maybe I can do it with openmediavault, maybe Nextcloud or ownCloud - doesn’t really matter (suggestions welcome), as long as
- it doesn’t want to manage the drives
- has a nice web GUI for managing users and shares
- can be mounted under Windows, preferably as a drive
- works in a container
- supports Backblaze or a similar cloud backup solution
Storage
Right now it’s looking like this:
Data (files and VMs): 6x1TB Samsung 870 Evo in raid Z2
- I’ve recently learned that MX500 tend to run hot and overheat in such environments
- yes, I know I’ll loose a third of it on redundancy, but it’s at the right balance point between my needs and budget
OS: 2x250GB Samsung 870 Evo in mirror
Large enough, that’s about it
High IOPS
If I do decide to run builds on this machine, it is a storage that I won’t mind loosing, so I can just throw a single M.2 NVMe in there somewhere.
Platform
Now, to the meat of the issue.
First, let me preface this by saying that I do not want a rack server - no matter what, it won’t be quiet enough to put in a bedroom.
I’m currently hemming and hawing between two solutions, a refurb T630 or a new AM4 build.
AM4
This is the interesting part:
-
ASRock Rack X470D4U - it’s cheap, has IPMI and ECC support, does what I want, even if I’m limited to PCIe3
- R5 3600
- 2x16GB 3200 MHz ECC DDR4 UDIMMs, or maybe 2x32GB, depending on budget
-
Silverstone SG11 - I wrote more about it here
- whatever SFX PSU I can get, either SST or Corsair
AM4 Pros
- small (270 mm (W) x 212 mm (H) x 393 mm (D), 22.5 liters)
- starting spec is faster than what I’ll be able to get with T630 in my budget
- whenever I upgrade my personal PC there’s a 5900X I can put in here
- x4x4x4x4 bifurcation
- this is what I really want
AM4 cons
- more expensive
- specifically, the memory is expensive
- much less IO
- not rack mountable
T630 16xSFF
This probably doesn’t need much comment, does it?
- waaaaaaaay more IO
- I can start it out cheaper
- quad channel memory
- redundant PSU (do I even need it?)
Cons
- huge and heavy
- won’t ever reach the performance of a 5900X (even dual 2690v4 will be a bit slower)
- 99% I won’t get the front fan assembly, so no passive cards
My thought process
Case and size
First of all, I’m really in love with that tiny Silverstone case. Also, while I have the room now, who knows how much space I’ll have in the future - so I’d prefer something easy to fit in a small space.
IO
At the beginning this may seem like a big deal. But unless my pay rises dramatically in the future, I won’t have the money to actually utilize it. And if it does, leaving this box behind won’t be an issue. What’s happening here is that in AM4 I’m maxing the on-board SATA ports, but at worst I can throw in a HBA later on. What would this box really need apart from a HBA or two and a NIC? And x8+x8+x4 should be enough for that.
TLDR: I’m probably just rationalizing going with AM4 because that’s what I want. But maybe this will help someone, and maybe someone can comment on this.