Level1: 172tb+ Storage Server | Level One Techs

docker is awesome, and i think he has a docker video already?

1 Like

Shelves have redundant controllers and each half of the backplane is independent . Each controller can access all the drives in all 4 shelves but the I/o load is split between the two . Each drive has an interposer so it connects to both controllers .

I was tempted to run raidz1 with 24 vdevs with one drive per enclosure lololololol

We will likely run two enclosures offsite as a mirror then recombine enclosures and add more vdevs with identical enclosures. Then use the full system as a backup. In the mean time if we see an opportunity in A year or so to upgrade well, we will take it

1 Like

I'm about 99% sure that this was simply done in jest to create more backstory for @kreestuh as the 'massive creep' and the zany office recluse. Looking for any hidden motive here is futile.

6 Likes

I have an active need for that much local storage. And I'm a poor grad student. Fuck.

Loooooved this video. I probably giggled a bit more then I should at the end with the faces @wendell was pulling when @kreestuh was sitting next to him.

2 Likes

Lady needs her TB's :)

1 Like

This was a great video, and why L1 is so great awesome!

I have a couple higher level questions about data storage/servers that I'd love some help with.

Over the next year, I want to migrate off other people's computers, but I don't want to rush into it without a long term strategy.

Obviously FreeNAS is great and the most likely place to start, but here are my questions.

1) If I move all my data to FreeNAS (with ownCloud or something), how do I also back up the NAS? I would be hosed if my house got broken into or there was a fire and had no backup of the NAS. So am I really looking at building two NAS boxes and is there a way to keep the "primary" backed up?

2) Seeing as how this is long term, what are the options for extending the storage capacity of an entry level FreeNAS system (~16 tb storage)?

My goal is to try and round up enough info to define an "entry level best practices for self hosted cloud with ability to expand as needed". Any advice on hardware, or educational material would be greatly appreciated!

Thanks!

You can use Tarsnap to back up your data remotely. Pretty much sign up get key and dump files to it.
There is also Crashplan and something else that I can't remember right off hand.
Mirrored vdevs are the easiest to upgrade/ add storage. You can do it with raidz1 and 2 but you have to have same size disk and amount of disk when you want to add storage. Depending on what you started with could be costly.

1 Like

Loving this nerdy stuff! I just have to voice how much I love this kind of content and how rare it is to find. I really hope you do more things like this. Maybe even talk about raid? Datahoarding has been my new hobby lately.

1 Like

Can someone do ELI5 on docker and what it does?

Loved the Video! Great information, would love to know if its possible and see a build/video if it is to offload the video from the editing workstations to a central rendering server.

Also would love to know the in depth details of how it was setup, did you have to setup each enclosure as its own vdev to be able to add an enclosure later on as an additional vdev? not sure of the limitations this would translate to with a small system where you'd start with 4 4-6TB drives and adding a drive as you need later or if that wouldn't be feasible with zfs

@wendell it would be interesting, but take it to next level. Set it up on hadoop and execute docker inside yarn on spark.

Krista, I didn't like the video nor subscribed to the channel because I don't have a YT account. What are you gonna do about it?

Nothing because know one cares what person A does or person B just the alphabet as a whole.

1 Like

Heh, looks like I'm not the only one then.

There have to be some bench marks to go along with it?

Noted.

3 Likes

We are still finalizing the config. Random Io is not great as you might imagine but we can easily hit wiresepeed on 10 gigabit

1 Like

For real though. I don't have like $4500 sitting around to build computers with. I don't need videos about Razer laptops and 1080s and other stuff. (The content for the Kaby Lake launch was good because it was sufficiently technical.) These videos on how to buy 50-500 bucks worth of junk and make something awesome with it are right up my alley though.

I just really appreciate and respect how Wendell is able to explain complex details and operations in a way that I think anyone could understand. It's like sitting through a lecture from an outstanding professor. I'm not about the Wendell worship that goes on, though it is sometimes funny, but I have a lot of respect and appreciation for him (and Krista and Ryan) and I'm really happy this channel/forum is pushing onward.

5 Likes

For my use cases, I'm actually going to want something like this. Level1Techs has a technologically diverse audience. There's a few researchers, security specialists, and electrical engineers on here.