I guess this drive is dying, argh... WD 16TB Helioseal (crapTM)

I’ve got a graveyard of WD drives and looks like another one’s going on the pile. I have the curse of “living in the middle of no where” - I can only order these from Amazon / BH Photo, but due to the change in region

  • WD won’t honour the warranty
  • Last time they wanted me to sign a letter saying I will no longer make claims for the remainder of the year
  • WD replacement drives are total junk, I don’t think they have similar MTBF and the bulk of the drives I’ve had in the past, about 8-16 have died in under 8 months.

Only a very very small set of 16x drives have now made it past 4-years. Yup the one that’s dying now is the last one, under 6 months. Eeek!

Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c5 60 00 00 01 00 00 00 length 131072 SMID 502 terminated ioc 804b (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 b1 06 bb 28 00 00 00 08 00 00 
Aug  6 21:23:23 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 96 70 00 00 01 00 00 00 length 131072 SMID 503 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary (da7:mps1:0:	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 70 68 00 00 00 28 00 00 length 20480 SMID 542 terminated ioc 804b l14:oginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 0): Retrying command
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c2 60 00 00 01 00 00 00 length 131072 SMID 255 terminated ioc 804b (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c5 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 55 38 00 00 01 00 00 00 length 131072 SMID 411 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary (da7:mps1:0:	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 94 70 00 00 01 00 00 00 length 131072 SMID 592 terminated ioc 804b 14:0): loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): WRITE(10). CDB: 2a 00 a6 5c 3e 68 00 00 08 00 length 4096 SMID 601 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c1 60 00 00 01 00 00 00 length 131072 SMID 301 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary Retrying command
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 c0 4e e5 b8 00 00 00 08 00 00 length 4096 SMID 396 terminated ioc 804b lo(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 96 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary ginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 93 70 00 00 01 00 00 00 length 131072 SMID 923 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 70 68 00 00 00 28 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c2 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 55 38 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 94 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): WRITE(10). CDB: 2a 00 a6 5c 3e 68 00 00 08 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c1 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 c0 4e e5 b8 00 00 00 08 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6c 20 00 00 01 00 00 00 length 131072 SMID 1068 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c0 60 00 00 01 00 00 00 length 131072 SMID 609 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 95 70 00 00 01 00 00 00 length 131072 SMID 321 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6e 68 00 00 01 00 00 00 length 131072 SMID 677 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 57 38 00 00 01 00 00 00 length 131072 SMID 61 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c3 60 00 00 01 00 00 00 length 131072 SMID 113 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 97 70 00 00 01 00 00 00 length 131072 SMID 398 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 99 70 00 00 00 f8 00 00 length 126976 SMID 407 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6f 68 00 00 01 00 00 00 length 131072 SMID 951 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 54 c4 5d 58 00 00 00 08 00 00 length 4096 SMID 816 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 bf 60 00 00 01 00 00 00 length 131072 SMID 280 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 14 06 a0 00 00 00 08 00 00 length 4096 SMID 618 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 98 70 00 00 01 00 00 00 length 131072 SMID 159 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 58 38 00 00 00 b8 00 00 length 94208 SMID 801 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 56 38 00 00 01 00 00 00 length 131072 SMID 329 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6d 20 00 00 01 00 00 00 length 131072 SMID 368 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c4 60 00 00 01 00 00 00 length 131072 SMID 403 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(10). CDB: 28 00 05 96 39 e8 00 00 08 00 length 4096 SMID 355 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(10). CDB: 28 00 03 89 16 30 00 00 08 00 length 4096 SMID 865 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(10). CDB: 28 00 03 86 b6 e0 00 00 08 00 length 4096 SMID 516 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary 	(da7:mps1:0:14:0): READ(10). CDB: 28 00 f0 0a bc 50 00 00 08 00 length 4096 SMID 708 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 21:23:23 freenas-primary mps1: Unfreezing devq for target ID 14
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 93 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6c 20 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c6 60 00 00 00 e8 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: Command timeout
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c0 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 95 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6e 68 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 57 38 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c3 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 97 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 99 70 00 00 00 f8 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6f 68 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 54 c4 5d 58 00 00 00 08 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 bf 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 14 06 a0 00 00 00 08 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 3d 38 98 70 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 58 38 00 00 00 b8 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 7f aa 56 38 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6d 20 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 03 c4 c4 60 00 00 01 00 00 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 05 96 39 e8 00 00 08 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 03 89 16 30 00 00 08 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 03 86 b6 e0 00 00 08 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 f0 0a bc 50 00 00 08 00 
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 21:23:23 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 90 d3 6c 20 00 00 01 00 00 00 
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): CAM status: SCSI Status Error
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): SCSI status: Check Condition
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): Retrying command (per sense data)
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): WRITE(16). CDB: 8a 00 00 00 00 02 81 78 f4 f0 00 00 00 78 00 00 
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): CAM status: SCSI Status Error
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): SCSI status: Check Condition
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Aug  6 21:23:24 freenas-primary (da7:mps1:0:14:0): Retrying command (per sense data)
Aug  6 22:00:18 freenas-primary 	(pass7:mps1:0:14:0): LOG SENSE. CDB: 4d 00 0d 00 00 00 00 00 40 00 length 64 SMID 441 Aborting command 0xfffffe0001a682d0
Aug  6 22:00:18 freenas-primary mps1: Sending reset from mpssas_send_abort for target ID 14
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 39 10 00 00 01 00 00 00 length 131072 SMID 581 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 92 1b 60 00 00 00 20 00 00 length 16384 SMID 327 terminated ioc 804b l(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 39 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary oginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d db 90 00 00 01 00 00 00 length 131072 SMID 799 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d da 90 00 00 01 00 00 00 length 131072 SMID 862 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): WRITE(16). CDB: 8a 00 00 00 00 03 de af 5d 60 00 00 00 08 00 00 length 4096 SMID 359 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 38 30 00 00 00 08 00 00 length 4096 SMID 307 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(10). CDB: 28 00 a5 bc c1 68 00 00 10 00 length 8192 SMID 766 terminated ioc 804b loginfo 31140000 scs(da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary i 0 state c xfer 0
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 92 1b 60 00 00 00 20 00 00 
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3e 10 00 00 01 00 00 00 length 131072 SMID 532 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary (da7:	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3c 10 00 00 01 00 00 00 length 131072 SMID 82 terminated ioc 804b lmps1:0:oginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 14:0): Retrying command
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 77 a8 e4 80 00 00 00 08 00 00 length 4096 SMID 941 terminated ioc 804b lo(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d db 90 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary ginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 18 37 86 30 00 00 00 68 00 00 length 53248 SMID 548 terminated ioc 804b l(da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): oginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary Retrying command
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3a 10 00 00 01 00 00 00 length 131072 SMID 480 terminated ioc 804b (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d da 90 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 18 37 86 e0 00 00 00 98 00 00 length 77824 SMID 934 terminated ioc 804b l(da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary oginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary (da7:	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d d9 90 00 00 01 00 00 00 length 131072 SMID 452 terminated ioc 804b mps1:0:loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 14:0): Retrying command
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3f 10 00 00 01 00 00 00 length 131072 SMID 954 terminated ioc 804b (da7:mps1:0:14:0): WRITE(16). CDB: 8a 00 00 00 00 03 de af 5d 60 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 a9 84 47 d8 00 00 00 08 00 00 length 4096 SMID 613 terminated ioc 804b lo(da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 38 30 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 a5 bc c1 68 00 00 10 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3e 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary ginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary (da7:	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 9b 05 e8 00 00 00 08 00 00 length 4096 SMID 170 terminated ioc 804b lomps1:0:ginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 14:0): Retrying command
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3d 10 00 00 01 00 00 00 length 131072 SMID 211 terminated ioc 804b (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3c 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3b 10 00 00 01 00 00 00 length 131072 SMID 762 terminated ioc 804b (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 77 a8 e4 80 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 18 37 86 30 00 00 00 68 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3a 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 18 37 86 e0 00 00 00 98 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d d9 90 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3f 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 ff ce eb 98 00 00 00 10 00 00 length 8192 SMID 248 terminated ioc 804b lo(da7:ginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d dc 90 00 00 00 b8 00 00 length 94208 SMID 429 terminated ioc 804b l(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 a9 84 47 d8 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary oginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 a9 83 e0 a0 00 00 00 08 00 00 length 4096 SMID 524 terminated ioc 804b lo(da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 01 e8 9b 05 e8 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3d 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 3b 10 00 00 01 00 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 02 ff ce eb 98 00 00 00 10 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 20 2d dc 90 00 00 00 b8 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary ginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 fb 9b 06 48 00 00 00 60 00 00 length 49152 SMID 793 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary 	(da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 40 10 00 00 00 f0 00 00 length 122880 SMID 298 terminated ioc 804b loginfo 31140000 scsi 0 state c xfer 0
Aug  6 22:00:19 freenas-primary mps1: Unfreezing devq for target ID 14
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 a9 83 e0 a0 00 00 00 08 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 03 fb 9b 06 48 00 00 00 60 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 57 df 40 10 00 00 00 f0 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: CCB request completed with an error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(16). CDB: 88 00 00 00 00 04 18 37 86 e0 00 00 00 98 00 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: SCSI Status Error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): SCSI status: Check Condition
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command (per sense data)
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): READ(10). CDB: 28 00 a6 5e 17 f0 00 00 08 00 
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): CAM status: SCSI Status Error
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): SCSI status: Check Condition
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Aug  6 22:00:19 freenas-primary (da7:mps1:0:14:0): Retrying command (per sense data)

da7 is ironically too big; I was planning to resilver this pool ad-hoc to 16TB drives.

Screenshot 2024-08-09 at 18.13.33

1 Like

When in the market for HDD, I use the Backblaze stats for HDD fails to determine my next purchase. WD is no longer a consideration for me. I used to be a huge HGST customer, but WD bought them out and the slippage in quality is noticeable since.

I still have a HGST Deskstar NAS 4TB (Toshiba ID) rocking it out even today on my home server that’s got about 3 and half years of power on time :woozy_face:

I’ve been replacing drives with bigger drives as they starts failing I’ve had good luck outside a few drives… Most last several years as a media server. Its all math and numbers I guess.

1 Like

A sidenote, is this the source script used for your very swanky report?

EDIT: yes it is, slightly harder to deploy on SCALE due to missing bc but doable for any dabbler and up. Details here.

Regarding WD, are you using consumer line hdds? Maybe thats why you are getting such runaround specifically. I cant parse exact drive you have from description, but it seems like standart go away treatment to minimize support cost.

Shouldnt be happening at enterprise support level for such clear cut and standard case. I had some hiccups with toshiba, as in I got my money back instead of drive replacement without warning.

I am from locale that where you do not deal with manufacturer directly , unless your seller entity gone/bankrupt. Your experience may thus vary.

Have you tried enterprise grades hdds from toshiba? They are generally cheaper that consumer/consumer+ lineups and have 5y warranty on top and are easily available in retail channel. Do not really understand why is pricing that out of whack, but it is. At least in europe.

Toshiba MG-series

2 Likes

Thanks, what drives are you using now?

I thought these drives are enterprise grade? I stopped using WD Red Pros (none of that single nonsense…)

Thanks for the Toshiba tip…

:woozy_face:

1 Like

This is available with $122 import taxes but it is not MG, it is however SATA + CMR

Thoughts?

A sidenote, is this the source script used for your very swanky report?

EDIT: yes it is, slightly harder to deploy on SCALE due to missing bc but doable for any dabbler and up. Details here.

BTW yes, although thanks, I need to update my script. I’m running a very old FreeNAS; it works so I’m not bothering with an upgrade.

So to summarize:

I remember reading that RMAing drives to toshiba directly is very fraud process, they supposedly do not want do deal with end customers, just OEMs, VARs and system integrators.

That non-issue in europe, but might be an issue in US. Just like the issues you are having now with WD.

EDIT: My setup

2 Likes

Sweet, thanks for the info.

Re Cap/Cost - yes, sorry that’s the only model I could see on Amazon, but I’ll be going 16/20TB for sure.

I can get this N300 PRO 16Tb to my friends place in SC - sadly, these aren’t available to ship directly to LK. Only good thing is these are stocked/sold by Amazon and not a 3rd party seller so I can recover from any DOA drives within 30 days.

1 Like

Because I am curious, what reason is WD giving for not fully honoring their warranty?


From my last correspondence in 2019. I’ve maintained logs of every “death”. For a while I used to run a full re-burn testing script which takes about 2-3 days for 16TB, but I’ve not being doing that and have a pile of WD drives.

Since these are no longer in use I don’t mind leaking the serial info. You’ll see I’ve tried re-rotating a few and they get marked as “BAD” with a sharpie and added to the pile.

16TBs are the WD Helioseal Enterprise drives, the Reds and Red Pro (CMR) are now either dead or in my 8-drive vdev called “Deadpool”. This pool is used for my gitlab backups; I need to sort this out though at some point.

P.S. I’ve ditched all WD Red shingled drives long time ago.


Interestingly my Deadpool are all 16TB WD Enterprise HDDs. It’s a weird vdev, I never planned to use it and should be 8x drives.


Guess I assumed too much, your situation is unusual and well outside my experience.

Doing RMA outside contry of purchase (region) explains a lot. While shitty, unless WD has global support policy as default or as additional paid service that you purchased, offered service was optional and generous.

They would be fully within their right to ignore you, which they thankfully didnt.

WD does not have presence in your country? Were drives sourced outside of your region, i.e gray market goods?

Thats massive complication, if toshiba does not have presence, then I would avoid them. You might have even worse experience with them in that case, based on anecdotal.

1 Like

Yeah, so I tend to order direct from Amazon.com (US) as they provide DDP “Delivery duty paid” shipping via UPS/DHL etc.

The other one that gets here and has been reliable are BHPhoto.com but that’s Door-to-door and I have to settle the duties on arrival. I tend to buy 4x at a time from both for RNG purposes hah.

Doing RMA outside contry of purchase (region) explains a lot. While shitty, unless WD has global support policy as default or as additional paid service that you purchased, offered service was optional and generous.

Well the cost of shipping return is something I would pay for in any case, but my gripe is there isn’t much point in getting a RMA drive as these have far less MTBF and I found they would also go belly up in < 6 months.

In any case, yeah I will just shop for the cheapest > 16TB deal with Amazon 30-day DOA return and hope for the best.

1 Like

Sri Lanka is a total mess. Most people here are struggling to scrap $100 together; it’s a local issue due to massive corruption, exacerbated by very low pay in the country. To earn $1,000/month means you’re in the 98th percentile easily.

No local agent stocks these, and if they did, their premium is more than what it costs to order direct off Amazon.

1 Like

Ahh, this makes sense now.

You bought your drives out of region. This happens sometimes. This is why you have to be very careful when you buy them, as many of the cheapest drives on Amazon, eBay and Newegg are grey market imports from other markets that don’t have local warranty.

Usually when I buy drives I run the serial number as soon as I get them, and if it is listed as out of market, I immediately return them to the retailer to avoid this problem.

WD and Seagate do the exact same thing here. In order to work in good faith they give you a limited number of out of market warranty replacements per year, but honestly, we are kind of lucky they support these drives at all. It would be completely within their rights to tell you to go pound sand.

Best advice I can give is to be more careful who you buy your drives from next time.

Unfortunately if you buy from Amazon this problem can’t be completely avoided, as while they have many sellers, the inventory from all the sellers is often intermingled in Amazons warehouses based on SKU. Since there is no way to tell which drives are in vs. out of market without running the serial number, this is never caught by Amazon. It only takes one bad seller to add grey market drives into inventory to randomly contaminate Amazon’s supply and this happens all the time and Amazon doesn’t seem to care. Your only recourse is to return them within the return period.

So the best thing to do is to obsessively run the serial numbers on the drives before use when you first get them, and demand an RMA within Amazon’s return period if you get a grey market drive.

Most of these shitty sellers will say “no need to do that, we will cover you if WD/Seagate doesn’t” but where is your guarantee that they will even be in business as a seller in a couple of years time when you need them?

I have 12x 16TB Seagate x18 drives in my NAS. I always make sure I check the serial numbers when I first get them just to make sure after a bad experience I had years ago (not much unlike your current one), but last time I got distracted during a busy week at work and forgot to check a few of them. Two grey market drives slipped through.

Luckily my two drives are unlikely to fail enough to hit the annual max RMA limit for grey market drives, so I am OK this time.

But yeah. Always always always run the serial numbers as soon as you receive them, preferably before even opening the sealed anti-static bag (if you can read them) and send them right back if they are not “in market”.

3 Likes