Newb, entering the "own your own stuff" space with a homelab

Hello everyone! I’m new to the forum, and got here from the Youtube channel. Been into computing since about ‘95. Got out of the nuts and bolts of the behind the scenes software stuff a long time ago and I’m having to relearn a lot. I’m enjoying getting back into it and I love making things, so it’s scratching a few itches.

I’ve wanted to do some sort of home NAS for a long time. Recently lost an entire drive of movies, so it finally pushed me to do something. Lowballed the heck out of a guy with an old enterprise server. Got a Dell Poweredge T340 with nearly 14TB of space spread out over 7 drives for $100. One drive was 8TB, turned around and sold it for $80. Got a Dell T610 with 8x4TB drives for $100, yanked the drives out, and sold the chassis for $150.

Now I’m modding the case to hold extra drives. The top of the case had 3 half height 5.25” bays. Two were blanks and one had a slimline optical drive. Gutted all of that and there’s plenty of room for all the storage I’ve accumulated and a fan to cool the extra drives. I’ll be at 16 drives in the case with a little extra room for future expansion.

All my drives are being set up as ZFS mirrors. I’m running two SATA 460GB SSDs for the OS. The rest of the storage; 4x1.2TB 2.5” SAS drives, 2x3TB SAS 3.5” drives, and 8x 4TB SAD 3.5” drives, are spread across 3 controller cards. My thought on that is to be able to pass an entire controller through to a VM and run my stuff like that. I’ll post some pictures later.

Any tips or traps for new gamers? Any input is appreciated. Hello again and thanks, everyone!

1 Like

I’d caution against passing through controllers to a virtual machine. I’ve read blogs on it being done without issue, but it’s a bit of work for not much reward. Streaming i/o generally doesn’t need the fastest speeds. You want to build your application layer independent of the hardware running beneath, this will make it far easier to manage as your lab grows.

Outside of that warning, I think you’re pretty much set from the looks of it. I’ve ran a rack in my apartment for a few years now and have leaned towards getting rid of my enterprise equipment and downsizing with Mini PCs as a hypervisor host and a dedicated box for NAS, but this is mostly because of the noise and electricity cost.

Interesting. It seemed like it was actually easier for me to hand the whole controller over to a TrueNAS VM. I was briefly playing around with setup before I found all the extra storage. I stopped and wanted to get my hardware situated before tinkering with the software.

I will definitely read more on it. Currently looking at doing Promox as the top layer.

Noise and power are not a consideration at the moment. Also, the T340 is a pretty low power machine at less than 500 watts fully loaded.

In practice, I honestly can’t say I’ve read about any catastrophic failures from passing through hardware controllers directly to a VM. It’s a lab anyways, so as long as you’re running backups I wouldn’t be particularly worried. It’s just not a solution I’d be comfortable keeping long term.

I’m new to all of the lab stuff. What specifically makes you uncomfortable?

Another layer of abstraction between the system handling all of your files and the drives they’re being stored on. When you have redundancy, it’s less of worry.

I’d much rather have a single dedicated NAS and a separate hypervisor host that utilizes it, rather than putting all of my services on one system, if this was a setup I was keeping around long term.

In your case there’s really nothing wrong with the proposed setup, especially if you have multiple controllers on it.

1 Like

The Poweredge T340, monitor, and keyboard I got for $100 which started this whole ride…

First attempt at extra drive bays.

Screw it. Time to get heavy handed.

Pulled the bezels off of the two tape drive blanking spots and the slim dvd drive. Hot glued them together and attached a couple ears off of one of the blaking bays.

Drew up and printed a wedge mount for the 140mm fan.

10 extra drives where there used to be nothing (and a dvd drive).

Fan in.

Fan peeking through the bezel.

A little cable management, fan controller for the front, and overall shot of the system.

Currently set up with a Xeon E-2174G at 3.8gHz, 48gb ram, Perc H730P in HBA mode, Perc HBA330+, and a Fujitsu D2607. Total storage is currently 43.76tb, but only half usable due to mirroring. As it sits, I’m all in for $99 plus my time.

If I squint, that last photo looks like a shot of a home’s kitchen

2 Likes

I’d caution against not passing through controllers to a virtual machine that is tasked with managing them entirely. You don’t want the host OS to even think it should be curious at the disks. the controller passing through isolates them completely.

As that’s the complete opposite advice, I leave further research on topic up to you.

With truenas moving bsd > linux base I’d actually suggest the use of a VM fileserver (e.g. truenas within proxmox) isn’t as much of a best-of-all-worlds situation as 3-4 yr ago. You may be best to consider just to run truenas (scale) on physical directly. it can run VM’s if you want something it doesn’t have apps for. I find ‘hyperconverged’ constrains how often I can do some things on the host (even with everything virtualized) as I want storage always to be up.

It can still work, but if I were setting up again I’d probably keep storage on its own physical host (& I migrated the backup to physical). (but perhaps you do need everything in one box, and that’s quite a valid use case).

1 Like

What I had researched was sending whole controllers to VMs was the best for what I am doing. I will continue to do further research and tinkering. Thanks everyone!

nice build lol, the wedge fan mount is great. one thing to check: the fujitsu d2607 is an lsi 2008 card and those usually ship with the raid (IR) firmware. for zfs you’d want it crossflashed to 9211-8i IT firmware (P20) so the disks show up raw with smart, otherwise it’s one more weird layer in between. the hba330 is already fine as is

also kinda debating if the 4x 1.2tb 10k drives are worth the bays, that’s under 5tb raw and they’re loud and hot for what they give. i’d keep them for vm storage at most and put 4tb+ drives in those slots later

Green marble brick below the cabinets and everything.

1 Like

Thank you. I already had the D2607 in another build when I figured out how to use SAS drives in my personal rig. I already changed it over to an IT flash and they all show correctly. If I had been buying another controller, I would’ve used another HBA330.

As far as the little drives being hot and loud, maybe, but the main fan is WAY louder. I didn’t buy the 1.2tb drives on their own, they came with the server. Waste not, want not. They will eventually get replaced. But for now, they’re running at 30C unloaded. Seems fine. Time will tell.

I also figured out all the firmware updates for the various modules. That was a PITA. The Dell Lifecycle Controller hung on almost every update.