Degraded Drive TrueNas Scale - How to reset?

[jquennez]

I have a drive in my pool that is showing Degraded, but has no SMART errors. How do I clear the drives degraded statues so that all is stable again without replacing the drive. Also I have two spares for each Raidz1 and in the Raid it is showing the spares as online, but at the bottom it shows two of the spares as unavailable??? What am I doing wrong? Thank you

TrueNas Scale System-
Dell Precision 7810
2x Xeon E5-2620 v4 (upgraded)
128gb ECC
LSI SAS 9300-16I SAS/SATA w/ 4 SFF-8643 to SATA
Boot Drives- 2x Mirrored SSD 512gb
12x mixed brands NAS or Enterprise 8TB HDDs
5x NAS Red WD 4TB HDDs
ASUS XG-C100C 10G x4 10g NIC
Video Cards (not used at this time)
Quadro P2000
Quadro M2000

[jquennez]

Image of the Spare Drives issue

[branchmispredictor]

If you open up the console, what does sudo zpool status -v print?

One wild guess is that your HBA card might be overheating and introducing errors - do you have a fan pointed at it? The 9300s run hotter than older generation cards.

[jquennez]

@branchmispredictor

sudo zpool status -v

I can add a fan to the unit and remove the unused Video cards to allow more air flow. It is in the original workstation case and has the stock fans

pool: T-800
state: DEGRADED
status: One or more devices has experienced an unrecoverable error. An
attempt was made to correct the error. Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
using ‘zpool clear’ or replace the device with ‘zpool replace’.
see:
scan: resilvered 4.06G in 00:02:33 with 0 errors on Fri Dec 29 11:46:40 2023
config:

    NAME                                        STATE     READ WRITE CKSUM
    T-800                                       DEGRADED     0     0     0
      raidz1-0                                  ONLINE       0     0     0
        b7af2373-9191-46ac-a6cf-2aa8437e96bd    ONLINE       0     0     0
        12db54d2-f030-4dbd-8535-b9b8f86e5781    ONLINE       0     0     0
        41483b95-3c35-498a-9130-b622bb7a8b6d    ONLINE       0     0     0
        spare-3                                 ONLINE       0     0     0
          c64f7f43-dcd7-4b60-946f-db5b06df13bc  ONLINE       0     0     0
          76e4328a-d71e-417b-8556-a4db63c4d59e  ONLINE       0     0     0
        76d97c6e-ed2c-4d9c-814e-7f93dc77a2ea    ONLINE       0     0     1
      raidz1-3                                  DEGRADED     0     0     0
        09110caf-3744-43df-b5cb-7662fbe504cb    DEGRADED     0     0     0  too many errors
        f53dec41-2634-4a9b-9abd-042117ac018d    ONLINE       0     0     0
        spare-2                                 ONLINE       0     0     0
          6e30f06e-a8ba-4f65-8b47-b03ef4a8c1f0  ONLINE       0     0     0
          18872d6f-51f1-4780-92b2-0a02d8f694e5  ONLINE       0     0     0
        a513b141-69b9-4ee3-b825-f85deb9ac5d4    ONLINE       0     0     0
        1e2811ff-eccf-4ed2-8f2c-9d39424d136e    ONLINE       0     0     0
    spares
      76e4328a-d71e-417b-8556-a4db63c4d59e      INUSE     currently in use
      18872d6f-51f1-4780-92b2-0a02d8f694e5      INUSE     currently in use

errors: No known data errors

[jquennez]

Also Thank You for the Status command above it allowed me to read the github info linked to the report and figure out how to clear the warning which now marked all items as good, just now have the issue of the bottom saying the two spares are unavailable. I have a pci slot 3 fan cooler for a video card that I can put in the slot below the HBA. I will do this and see if we get errors again. Thank you!!!