Without seeing all of your scripts and output logs of stuff you run it is difficult to say. I for 1 know that one version of pop os didn’t copy kernel module to boot efi when doing update-initrams. Are you getting in output log the fact that kernel stub copied generated kernel image? Post information.
I will try and provide as much information as necessary
Here is my bind_vfio.sh file
#!/bin/sh
PREREQS=""
DEVS=“0000:09:00.0 0000:09:00.1”
for DEV in $DEVS;
do echo “vfio-pci” > /sys/bus/pci/devices/$DEV/driver_override
done
I ran these commands:
sudo kernelstub -a 'amd_iommu=on'
sudo kernelstub -a 'iommu=pt'
sudo kernelstub -a 'iommu=1'
And this is the update-initramfs -u output
update-initramfs: Generating /boot/initrd.img-5.4.0-7629-generic
cryptsetup: WARNING: Resume target cryptswap uses a key file
W: Possible missing firmware /lib/firmware/amdgpu/navi12_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_vcn.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/navi12_smc.bin for module amdgpu
W: Possible missing firmware /lib/firmware/amdgpu/arcturus_smc.bin for module amdgpu
/etc/initramfs-tools/scripts/init-top/bind_vfio.sh: 4: 0000:09:00.1”: not found
kernelstub.Config : INFO Looking for configuration…
kernelstub : INFO System information:
kernelstub.Installer : INFO Copying Kernel into ESP
kernelstub.Installer : INFO Copying initrd.img into ESP
kernelstub.Installer : INFO Setting up loader.conf configuration
kernelstub.Installer : INFO Making entry file for Pop!_OS
kernelstub.Installer : INFO Backing up old kernel
kernelstub.Installer : INFO Making entry file for Pop!_OS
Let me know if there is anymore information you need. Thanks!
you should specify your vfio_pci device ids in /etc/modprobe.d/vfio.conf, and use softdep amdgpu pre: vfio vfio-pci to make sure that vfio loads before amdgpu…
Short version of the binding guide:
lspci -knn, get your device ids, for everything.
throw those ids into this line in /etc/modprobe.d/vfio.conf: options vfio-pci ids=[ids_here_comma_separated]
preload vfio-pci: softdep amdgpu pre: vfio vfio-pci. Repeat this with nouveau and nvidia as well.
make sure vfio is in your initramfs, put vfio, vfio_iommu_type1, vfio_virqfd, vfio_pci into /etc/initramfs-tools/modules
Assuming you did, you might need to add vfio-pci.ids=1002:67df,1462:aaf0 to your kernel command line in /etc/default/grub and rebuild your grub config.
On my Ubuntu 19.10 system, my passthrough setup is working with the exact config I mentioned in my above post, so I’m not sure why yours isn’t.
If you continue to have issues, can you confirm that vfio is built, by running sudo modprobe vfio