Can't add slot back to host

To make a long story short I used an AMD GPU in my top PCIe slot to pass through to a Windows VM but there seems to be some sort of issue that prevents me from using the VM so I figured I’d add the GPU back to the host. I removed everything I can think of that I did to isolate the GPU and add it back to the host but nothing works. I also changed the slot that it’s in. Now I can’t auto load GDM and I have to manually start it by hitting ctrl+alt+f2 and then with f1 and I’ll see the login. Then when I login I can only do so with Wayland not xorg. For me to use xorg I have to change the GPUs slot and then I can use my second Nvidia GPU to launch xorg.

I removed any sight of the PCIe id’s. I generated my initram and grub config. I removed the stuff I added to grub options and nothing. Lspci -nnk shows that the GPU in question is using amdgpu driver and kernel module.

Not sure why it doesn’t work.