IOMMU Grouping mess up

TLDR:
I wanted to revert vfio gpu passthorugh so I removed the vfio flags from my modules in mkinicpio.conf this rebooted to a choppy display so I update the graphics drivers with sudo mhwd -a pci nonfree 0300 the graphics didn’t display so I removed the mhwd config from /etc/modprobe.d/ which worked but then my IOMMU groups for my gpu did this:

[ 0.488722] pci 0000:01:00.0: Adding to iommu group 1
[ 0.488725] pci 0000:01:00.1: Adding to iommu group 1
[ 0.488727] pci 0000:01:00.2: Adding to iommu group 1
[ 0.488729] pci 0000:01:00.3: Adding to iommu group 1

[ 3.648377] pci 0000:01:00.3: Removing from iommu group 1
[ 3.665864] pci 0000:01:00.2: Removing from iommu group 1
[ 3.681714] pci 0000:01:00.1: Removing from iommu group 1

Long story:
I recently tried to revert my vfio gpu passthrough by removed the module statements for vfio in my mkinitcpio.conf (to be clear I changed it from MODULES=(vfio_pci vfio vfio_iommu_type1 vfio_virqfd) to MODULES = ()). The gpu display was then tearing and very choppy so I though updating the drivers would help , I did sudo mhwd -a pci nonfree 0300 and reboot the system. This led to the gpu not displaying and upon removed the mhwd config file from /etc/modprobe.d/ it began to work again. Reflecting on this I should’ve just power cycled the system. However upon inspection of my iommu groups to test that I could return to gpu passthrough I notice that I was missing 3 of my gpus components this is the output from sudo dmesg | grep -i -e DMAR -e IOMMU

[ 0.488722] pci 0000:01:00.0: Adding to iommu group 1
[ 0.488725] pci 0000:01:00.1: Adding to iommu group 1
[ 0.488727] pci 0000:01:00.2: Adding to iommu group 1
[ 0.488729] pci 0000:01:00.3: Adding to iommu group 1

[ 3.648377] pci 0000:01:00.3: Removing from iommu group 1
[ 3.665864] pci 0000:01:00.2: Removing from iommu group 1
[ 3.681714] pci 0000:01:00.1: Removing from iommu group 1

Previous to this process all the devices were in the same group and were working properly.

I am at loss here at what to do
Will I need to ACS patch?
Is it possible to revert the iommu groups adding the graphic card’s components back to grouping without ACS patching?
Thank you,
Any help will do