Storage Server Update: Hardware, Optane, ZFS, and More! | Level One Techs

Level1Techs
1

********************************** Thanks for watching our videos! If you want more, check us out online at the following places: + Website: http://level1techs.com/ + Forums: http://forum.level1techs.com/ + Store: http://store.level1techs.com/ + Patreon: https://www.patreon.com/level1 + L1 Twitter: https://twitter.com/level1techs + L1 Facebook: https://www.facebook.com/level1techs + L1/PGP Streaming: https://www.twitch.tv/teampgp + Wendell Twitter: https://twitter.com/tekwendell + Ryan Twitter: https://twitter.com/pgpryan + Krista Twitter: https://twitter.com/kreestuh + Business Inquiries/Brand Integrations: [email protected]

This is a companion discussion topic for the original entry at https://level1techs.com/video/storage-server-update-hardware-optane-zfs-and-more
1 Like
2

What did you mean by “using multiple zpools”? … one raidz2 per pool?

3

Misspoke meant vdevs lol sorry. Each vdev is raidz2 across some different pools

4

A Steam cache setup guide or video would be great. I’ve been thinking about getting one running for some time now.

2 Likes
5

if I heard you correctly…

you only created one 60G partition on the optane for zil and you created another two partitions; one for cache and other for…?
Based on screenshot

image
image.jpg812x257 42.3 KB

6

I just came to wag my E-Peen at Wendell.

SAN/NAS

Supermicro Rackmount 4U w/ Red. 1280W Platinum P/S
24x: Samsung DDR4 2133MHzCL15 32GB (PC4 2133) Internal Memory M386A4G40DM0-CPB
2x: Intel 2.20GHz Xeon E5-2630 v4 Deca-Core (10-Core), 25MB Intel Smart Cache, Socket-2011-v3 (FC-LGA14A)
24x: HGST Hard Drive [HUH728080AL5200] 8TB SAS 12Gb/s 7200RPM 3.5in, 128MB Buffer, Internal
Supermicro Motherboard S-2011 R3 for 2x E5-2600 v3 MFG Part Number: X10DRi-T4+
LSI Logic Controller Card H5-25573-00 9300-8i SGL SAS 8Port 12Gb/s PCIE3.0 HBA Brown Box
QLE2562 dual 8Gbps Fibre Channel
2x: Supermicro 4U Active CPU Heatsink f/ X9 Socket 2011 MFG Part Number: SNK-P0050AP4
2x: ASUS HYPER M.2 x16 PCIe Expansion Card

2 Likes
7

The middle one has a typo and didn’t create anything

8

I have more than one storage server you know :wink:

15223702814591849079780
15223702814591849079780.jpg2121x2828 2.31 MB

10 Likes
9

Now your just braggin :slight_smile:

2 Likes
10

lol, Well my home rack will give you the cringe.

MVIMG_20180329_225649
MVIMG_20180329_225649.jpg945x1260 302 KB

3 Likes
11

I have the problem where I have too many hard drives for the case that I use for my storage server.

12

Gcs8, needs more RGB.

13

Cool vid wendell!

I’m running below with Proxmox:

Chassis: Supermicro CSE-826TQ-R800LPB
Backplane: BPN-SAS-826TQ 12 3.5" SAS / SATA Direct Attached Backplane 6GBPS SES II
CPU: 2 x Intel Xeon E5645 2.4Ghz Six Core
RAM: 144GB RAM DDR3 ECC REG DIMM (18x 8GB)
OS DIsks: 2x Crucial MX300 in ZFS mirror
non-OS Disks: 12x WD Red 4TB in ZFS RAID10
Have been thinking about adding a ZIL or L2ARC but performance is OK for now, mostly idle.
VMs for pihole, aptmirror, ansible, onlyoffice, nextcloud, jitsi, plex, pxeboot, wiki and a few others
Hosting some silly things like: https://zaggy.nl/netherlands/
Am slowly poking away at automated installation through pxeboot.
I uh also am in need of a noise dampening server rack enclosure something, it’s currently sitting in my attic on some carton boxes with fans in desktop mode, not too noisy until it gets busy, will take off then.
Have looked at apc netshelter mini and equivalents but they’re expensive, I could try to DIY something myself?

Am interested to see how you’d deploy the caches for Steam/Blizzard/Origin downloads.

14

I would love to know what ecc memory kit @wendell used in this build. I am also using the X370 Taichi but ASRock’s memory QVL is sparse on ecc kits - expecially for 16gb dimms. Thanks for the help!

15

There was a screen shot of it at the beginning

16

@Wendell Great video! I love your hardware/ZFS/GODMODE stuff.

How did you get the steamcache at 10Gbps? I might have blacked out due to the awesomness of the video :frowning: , was it a network component?

You guys really inspired me in the original video to get my own steamcache going, but right now my Internet speed is faster than my LAN connection lol. Getting 10Gbps would be awesome. I actually got the steamcache going with Docker containers. It was too easy, I didn’t think it worked :exploding_head:

17

lol just some dnshackery + docker and thats it. LITERALLY IT
they even have an example script to show you what the cache is doing. be warned however you have some fiddling to do to get the blizzard/etc cache to work correctly

18

r/cablefail. NOW.

Optane sounds really interesting now in it’s SAS 2.5’’ form factor. Might consider it for my Threadripper build, since the endurance and random IOPS is better on Optane.

2 Likes
19

The whole house is RGB from the Lifx bulbs through the house.

20

I don’t get paid to make things pritty at home, only at work.