NAS Linux OS recommendation that supports 100 Gbps Infiniband

Software & Operating Systems Linux
21

had a look at the freenas kernel modules in /boot/kernel
ipoib.ko, mlx4ib.ko, mlx5ib.ko are there and hence should support your mellanox gear.

No RDMA Modules that i could spot, neither could i jet figure out which NFS version is in the current 11.2U7

https://wiki.freebsd.org/InfiniBand

freenas might get iSER support later this year. Might*

22

You’ll need two cards, the switch, and two DAC cables.

It’s too bad that you can’t run emulated hardware to be able to test this.

The idea isn’t just to migrate from something that I don’t have now to another thing that still doesn’t have the thing now.

The purpose behind the question was intended to see if there is an option that I wasn’t aware of before, so that I will be able to migrate from a thing that I don’t have now to something that I will have in the future.

As it stands right now, if I want NFSoRDMA, my CentOS nodes have that, but it doesn’t have the “pretty” NAS GUI.

Conversely, FreeNAS/Qnap has the “pretty” NAS GUI, but no NFSoRDMA.

Thank you, though, for helping me with doing some of the leg work in order to try and find out what’s in the realm of possible.

It’s greatly appreciated.

Thank you.

23

have a look at the cockpit thing then.
someone even did a ZFS interface for it

Cockpit project:

1 Like
24

Thank you.

I’ll have to check that out.

25

Freenas 11.3 dropped and I will have a look for iser once again.

26

Bummer. :frowning:

Will that be an iSER client or will that be an iSER server?

27

iSer on the serverside.
Clientside is with Linux as Clients no Problem i hope / assume.

28

no luck, not in 11.3 jet.

29

Bummer.

So…it looks like it might be Cockpit for CentOS then?

(Sidebar: For some strange reason, I wasn’t able to get the nfs-kernel-server to work in Xubuntu 16.04 to serve up NFSoRDMA, even with rdma_core installed.)

CentOS worked. Xubuntu as a server didn’t. (But as a client, it will mount NFSoRDMA, but will use port 0 instead of port 20049.)

30

no experience with cockpit on my side jet.

But nice that it looks like a viable option.

31

Yeah, I’ll have to look into it. It looks like it might be an option as well.

32

seems like there was a bit of progress on the iSER and Freenas side.

Seems like compiling a custom version was now done successfully.

Found it on here from this guy

1 Like