did not read everything, but do your GPUs actually have different IDs? I encountered funny issue, when i bought RX570 this week… it has same ID as RX580 
so i had to follow this guide:
VFIO in 2019 -- Pop!_OS How-To (General Guide though) [DRAFT] (at least the part with assigning vfio-pci driver to it)