I wasn’t paying attention and he reached into the top of the server while I was working on it. Now three out of the four Metadata drives (in mirror) have checksum errors.
I used the Storage configurator to remove each drive, one at a time and format/wipe it. Now I have one Metadata drive and three unassigned drives. I immediately tried to add the newly formatted drives back into the Metadata portion of the Pool but Truenas is insisting that the single remaining metadata NVME drive is a Stripe and refuses to add the three re-formatted drives back in to create the original, desired Mirror.
It explicitly errors out as a mismatch, Stripe - Mirror.
Any advice at all before I delete the entire array, re-make it, and restore it. Thank you.
Use 2 of the unassigned drives to create a new array, copy files from the existing drive to the new array, wipe the old array and add the remaining drives to the new array.
pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using ‘zpool upgrade’. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:00:29 with 0 errors on Wed Jun 14 03:45:30 2023
config:
Better to “replace” one dummy/missing drive listing though as the other drives were detached, instead if faulted, the 4 deep mirror is now a 1 deep raid0
Unless GUI is funky?
Personally I would be super careful now, with entire pool hanging on 1 drive, no redundancy
I would carefully DD the working drive To a formatted one, place copy to one side, then in truenas, attach one if the other formatted drives to the working one
This sounds very interesting but it’s my understanding that the single remaining Metadata special vdev must remain associated with the Pool or the Pool will be destroyed. That is why I had quadruple redundancy.
yeah, attach is what you want in this case. In the past when I’ve been in this situation the broken mirrors in special were still there? But they aren’t in your case. ‘attach’ and ‘special’ qualifiers… should… work in this case. Probably.
I want to thank you for everything that you do. I bought more than several 118GB Optane sticks from Newegg when your video dropped (at rock bottom prices), and also the pcie 4x NVME card for redundant Optane Metadata vdev on your recommendation.
As a dabbler for many years, your deep-dive insights are beyond educational and beyond appreciated. Also, “hi” to the whole gang.
yes I used the Add GUI after re-creating the Special Mirror successfully, and it added the last drive by itself … oof.
So I corrected the single Metadata zaid0 situation … now 3-way mirror but the 4th drive is hanging out there on it’s own. Im 90% to the solution Im sure.
welp, two options now. destroy pool or add one more nvme and have a striped mirror. You could possibly remove one of the mirrors from the 3 way mirror safely-ish. then you have a striped mirror which isn’t too bad in terms of redundancy.