I’m migrating a home media server from raid6+lvm2 to zfs, however it seems that not all files are copied correctly…
First I tried with rsync: the copy ended without errors(*), but since I’m paranoid and I don’t want to lose my data, I did another run with rsync which, to my surprise, started copying some files again.
The rsync command is the following:
rsync -a -c --progress /mnt/srv/casa/ /srv/casa/
Since I’m really paranoid and I really don’t want to lose my data, I’ve created a script that does md5 checksum file by file… and it turns out some files are different, and I double checked with sha256sum:
sha256sum /mnt/srv/casa/data_backup/navicella-linux-2018-04-04/odroid/debian-pan.img 6a5c6dd185e5526b50e5f2190a578db6ae93d44f3cbee8206678d3584b771996 sha256sum /srv/casa/data_backup/navicella-linux-2018-04-04/odroid/debian-pan.img e98d53453c6a0545c8b81ae0df178b747f7d33746972e3922e0aecfdb177753c /srv/casa/data_backup/navicella-linux-2018-04-04/odroid/debian-pan.img
So the files are really different.
Just to be sure, I also tried to copy the file with tar:
tar cf - * | pv | tar xfp - -C /srv/casa/
but the files are still different.
zpool status does not show anything particular (apart from two errors on files that are not really important; and please ignore the degraded state of the array):
status: One or more devices has been taken offline by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
action: Online the device using ‘zpool online’ or replace the device with
scan: none requested
NAME STATE READ WRITE CKSUM bpool DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 ata-ST2000DM006-2DM164_Z4ZAMLX9-part3 ONLINE 0 0 0 ata-ST2000DM006-2DM164_Z4ZAQ5ZH-part3 ONLINE 0 0 0 ata-ST2000DM008-2FR102_WFL353JL-part3 ONLINE 0 0 0 ata-TOSHIBA_HDWA120_857N5DYKS-part3 ONLINE 0 0 0 ata-TOSHIBA_HDWA120_86140KXGS-part3 ONLINE 0 0 0 /tmp/fake-part3 OFFLINE 0 0 0 errors: No known data errors pool: rpool state: DEGRADED status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://zfsonlinux.org/msg/ZFS-8000-8A scan: resilvered 150M in 0 days 00:00:12 with 0 errors on Wed Dec 23 11:34:09 2020 config: NAME STATE READ WRITE CKSUM rpool DEGRADED 0 0 0 raidz2-0 DEGRADED 0 0 0 ata-ST2000DM006-2DM164_Z4ZAMLX9-part4 ONLINE 0 0 0 ata-ST2000DM006-2DM164_Z4ZAQ5ZH-part4 ONLINE 0 0 0 ata-ST2000DM008-2FR102_WFL353JL-part4 ONLINE 0 0 0 ata-TOSHIBA_HDWA120_857N5DYKS-part4 ONLINE 0 0 0 ata-TOSHIBA_HDWA120_86140KXGS-part4 ONLINE 0 0 0 /tmp/fake-part4 OFFLINE 0 0 0 errors: Permanent errors have been detected in the following files: /srv/casa/incoming/navicella/salome_7.5.1/salome_appli_7.5.1/bin/salome/PYLIGHTGUI.pyo /srv/casa/nwnx4/lib/ruby/lib
So, what could be the cause?