I am having a slightly different experience on an RX470 (MSI). I can issue the remove command without error, and it does indeed work. But rescan either does nothing or returns the “invalid argument” error. Even after suspending and waking, rescan does not bring back the card according to lspci.
I started a thread about my particular issues here: Yet another AMD reset bug thread (RX470)