Truenas Data Migration/Transfer

Question for the experts:

I have finally finished setting up my primary Truenas-1 which is Baremetal, and setting up Virtualized Truenas-2 in Proxmox.

Truenas 1 has 2 onboards 1gig ports, and a 2 port 10gig X550-t2 card.

Truenas 2 has hardware pass through and all the drives and 2nd X550-t2 installed.

The two machines are connected directly to each other through 1 10gig port with a separate static I.P not part of the primary network of the 1gig cards, and see each other.

I want to migrate the data from Truenas 2 to Truenas 1 through the 10gig connection.

I have watched various vids and read several Truenas Forums on the process but it escapes me and still does work.

I know some do replication, some do rsync etc.

Basically, I am wanting to achieve an exact 1 to 1 copy from one to the other.

I have tried to setup rysnc according to Truenas, but some where along the line is gives me errors and wont start the transfer.

Unless I am wrong, you have to setup the task on both machines, and the parameters I guess are what’s mucking is up for me.

Let me know what you have done and the steps. I have not seen any updated videos on a Truenas-to-Truenas data migration/transfer.

1 Like

Are you replicating the data in order to migrate to a new system, or in order to back it up?

If it’s for backing up, do you plan to continue incrementally backing up TrueNAS 1 to TrueNAS 2 in the future?

I would recommend just getting Replication working. It’s ZFS (and TrueNAS) native, faster than rsync (from everything I’ve seen), and it elegantly handles incremental backups. There may be arguments in favour of other backup methods… maybe for some more niche or edge cases but for your average backup or replication job, I’ve yet to see a convincing argument against native ZFS Replication.

You could also use another tool to perform the Replication. I use Sanoid and Syncoid personally. So you might want to take a quick look at them to see if they better suit your needs.

I am wanting to copy everything over as it is. I cannot get rsync to work on the second set of network cards to bypass the network. The instructions that Truenas has is not very clear on the the process period, let alone peer to peer.

You can choose which NIC is used for the SSH connection (and that will also be used for the sync tasks).

If i remember correctly that is done is the services settings pane under SSH.

Did you get a specific error message when the task failed?

I am in the process of recreating the issues again as we speak. I was using Module task as opposed to SSH task. If I go through SSH I need to read the process of setting the keys and handshakes.

1 Like

Also, I am using the internal Rsync service inside Truenas, not the App. This is my next test.

Sounds good. I use the internal rsync tasks as well. Let us know what error it throws if you can and we’ll rock it from there.

With the help of tools like GoodSync , Gs Richcopy 360 and Syncback , you can migrate the data from Truenas 2 to Truenas 1 , easily ,directly and quickly

So why exactly aren’t you using snapshot replication between pools? This is both the easiest and fastest way to do things if both source and target are ZFS. This is 100% 1:1 “block-compatible” :slight_smile:

2 Likes

Thanks for all the replies. So revisited Tom’s video and Craft, and was able to create and test a replication with no major problems other than adjusting dataset settings. My only major issue at this point is the 10 gig peer to peer networking. The reason I’m really bent on this, is cause at 1gig the transfers take about 30hours, where as using 10gig takes about 4hrs.

This is the status on the primary bare metal Truenas:

Truenas-1a Baremetal

This is the status on the secondary vm Truenas:


Truenas-2a as a VM

They both show a link to each other through the cards, but Truenas 1 doesn’t see the other card settings.

They are both on the same i.p. address scheme.

Ideas?

1G is 20yr old tech at this point. Use 10G+

And replication will be way faster after the first one, with only changes between the snapshots being transferred.
With ZFS I was doing snapshots every 30min, replications were usually 3-5sec.

It gets a background job really quickly after the initial transfer of the first snapshot.

I’m trying to get the 10gig cards on each Truenas to communication peer to peer. As I posted They see each other, but one won’t see the other. One is a Dell X550-T2 and the other is a Silicom X550-T2.

It looks like you are looking for an interface named enp6s17 on TrueNAS 1 (“bare metal”), but there is no such interface on that computer. The interface is something that the local network software is using to communicate with the hardware; it’s not something that is supposed to be visible over the network!

Which IP network are you using for the direct connection? 192.168.0.x/24? If so, TrueNAS 1 should be able to ping TrueNAS 2 at 192.168.0.2 and vice versa. (This assumes that no other NICs use the same 192.168.0.x/24 network since that would mess up your gateways settings.)

Are you serving local DNS names for your LAN?

The enps6s17 is the one 10gig on the vm Truenas, referenced on the Baremetal which makes no sense if they are connected.

Yes they are using 192.168.0.2 and 3 addresses.