Single GPU passthrough without a displaymanager

Hello Level1Techs forum!

I have been wanting to get my single GPU passthrough work without a display-manager i.g lightdm. When I turn off my VM tty is not showing up only a black screen. The only way I have found to get display output is to start a display manager with a hook script. Is there a way to make single gpu work without a display-manager.

My startup script

#!/bin/sh
set -x

systemctl stop lightdm.service

echo 0 > /sys/class/vtconsole/vtcon0/bind
echo 0 > /sys/class/vtconsole/vtcon1/bind

echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind

sleep 2

modprobe -r nvidia_drm
modprobe -r nvida
modprobe -r nvidia_modeset
modprobe -r nvidia_uvm
modprobe -r drm

modprobe devname:vfio/vfio

My power off script

set -x

# Reload nvidia modules
modprobe nvidia_drm
modprobe nvidia
modprobe nvidia_modeset
modprobe nvidia_uvm
modprobe drm
modprobe -r drm_kms_helper

# Rebind VT consoles
echo 1 > /sys/class/vtconsole/vtcon0/bind
echo 1 > /sys/class/vtconsole/vtcon1/bind

nvidia-xconfig --query-gpu-info > /dev/null 2>&1
echo "efi-framebuffer.0" > /sys/bus/platform/drivers/efi-framebuffer/bind

# Restart Display Manager
systemctl start lightdm.service

EDIT: formating