I remember seeing a tutorial to enable a menu so you can choose which VM to open, but cannot find it now. I’d like to install as clean a Proxmox as possible on a laptop and use the VMs on that laptop using the laptop itself.
So basically re-creating Qubes with Proxmox?
Ooh, did not know about that, thanks for the link. I need to read some documentation.
Wow, that has it’s own universe of possibilities and restrictions. Although I like the ideas, I have some AMD processors in the mix, and those are frowned upon by Qubes. So I’d still like to make Proxmox usable on a single PC.
What is the goal you’re trying to achieve with this setup?
Proxmox is server OS, this not going to be straight forward.
Make better use of a laptop, enabling having multiple VMs open, without the burden of HyperV or the like. Preferably without adding stuff like a graphical layer and a browser to the Proxmox host
So you want no graphical user interface? So just boot to tty? And then run multiple VMs without using the Proxmox web-ui? You can only pass through the (i)GPU + eDP Laptop Display to one VM at a time (if possible at all). Or will all VMs don’t have any graphical intreface as well and you will just ssh into them?
Sorry I still don’t get what you want to archive.
Hmm.
I’m not sure Proxmox is the right tool for this. It is really a server implementation.
I mean, it is possible.
Many have done things like this on desktops, where they use Direct IO forwarding of a PCIe graphics card to the VM in Proxmox and thus use that as the graphical output, and forward USB devices (mouse and keyboard) for your input.
That said, in a laptop you aren’t going to have the ability to have a whole lot of GPU’s to forward. There is typically at most two of them (integrated on CPU + some have a secondary GPU) but I am not entirely sure how independently of each other they can work, and how you can switch outputs between them on a laptop.
This is not going to be straight forward, and I don’t think it will work as well as you hope.
As much as I hate to say so, you are likely better off just installing a lightweight host OS that uses a Desktop like LXDE, LXQt or maybe XFCE, and run your VM’s inside VirtualBox or VMWare workstation.
(While I personally like KVM better than either of those, KVM still has very poor performance when using emulated graphical outputs.)
LXDE can sit idle on the desktop with as little as 200MB RAM usage, so if you do a basic install of it that excludes all the extras and you just use it to launch virtual machines that run in full screen mode, you really won’t have a lot of wasted resources.
What is the workload that the individual VMs will be performing?
This sounds more like you want to dual boot than run VMs.
You could pick any distro and run cockpit to boot up vms in your browser and use the browser to view them.
What I would like is to boot to tty, login, and then have a menu of available VMs. The laptop has both an iGPU and a dGPU. In my mind it could be possible to have a VM use the dGPU via passsthru if it needed one. The reason I listed tty is to install the least amount of extra on top of vanilla Proxmox VE. And I think it would use less resources if the intermediairy layer is as light as possible. But I am coming to the conclusion I took to big a toke from the pipe., and this dream is too far from reality.
I found several sources using a combo of xfce or lxde or lxqt, and I have looked at this: GitHub - joshpatten/PVE-VDIClient: Proxmox based VDI client. It’ll have to do.
If you’re actually using your laptop (screen, kb & touchpad), I’d say not to go with proxmox, but instead use virt-manager (libvirt). You could probably, maybe pass your dgpu to 1 VM at a time and use LookingGlass to access it.
Some laptops have a display port (typically hdmi, but it could be displayport) that is connected straight to a dGPU (and bypasses the iGPU), which could be handy if you want to use an external monitor with a GPU you pass to a VM (assuming you can also pass a USB port to a VM for separate controls). Certain gaming lenovos are known to do that (but most laptops have all displays connected to the igpu and the dgpu copies data through the igpu to display).
If you really want to go with proxmox, then something light, e.g. lxqt, or just plain openbox or jwm (or sway if you fancy tilling WM) would be what you want (they really don’t take all that much resources, you can easily run these in <150MB of RAM and leave everything else for VMs).
If your laptop doesn’t have a lot of RAM, I’d suggest you don’t use a ZFS backend (not that it wouldn’t work, but idk how much you want to allocate to your VMs and how much would be left for ZFS).
Read your comments and I still don’t get your use case. I understand what you want to do, but how do you plan to use these VMs? As a pick my OS of the day? If that’s the case Why not dual/triple booting the OS? Sounds like you want unfettered access to the Host resources, and Virtualization may not be the path. (Honestly sounds a bit like GRUB with virtualization)
Another side step is to use Distrobox and run all your OS-es through containers. You could minimize- reduce the footprint of your base OS to the point where rather than VMs, you could rely on containers - and run proper VMs on the side if needed. You can even use GPUs through containers if needed.
What I can intuitivelly think to get this done using Proxmox is installing an RDP software to Proxmox and X11. Create internal virtual networking to hook your VMs to said RDP client and start everything on boot.
This way you should boot to what can be described as a “think client solution” and from there connect to whatever VM you want.
Start one on boot to have access to the Proxmox web GUI.
This is extremely convoluted but it could work I think. And battery life on your laptop would be laughable. I doubt you’ll get over an hour of usage this way.
I want to have some Windows VMs available, for Domino Designer. And I might also acces other VMs on another ProxMox instance, or use the laptop as a provider. lots of use cases, because lots of different uses.
Windows isn’t the problem here, it’s what you think proxmox can do for you.
He’s suggesting you use virt-manager which is a Linux GUI application for managing kvm/qemu virtual machines on any distro you’d like. I agree with this approach as it’s a much more standard use case.
I’m not sure how virtualizing everything here helps you. It seems like you really only want to use 1 os at a time given it’s a laptop with only one display.
Idk what sysreq does Domino Designer need. Does it need a beefy GPU? I doubt you can do much with a built-in gaming dGPU (assuming that’s what you have and not some kind of “mobile workstation-class” laptop with some quadro GPU). If you need multiple VMs with GPU acceleration, your only option would probably be SR-IOV. Not something most people can pull-off and almost certainly not on a laptop.
If the VMs don’t need GPU-acceleration (or only 1 of them does), you’re fine with either proxmox or virt-manager. And for the “other proxmox instances” you don’t need any kind of integration. You can have VMs running on virt-manager on your laptop and other VMs running in proxmox on another host. You don’t need to cluster your laptop with the other host (and I would very much encourage against that).
On your PC, you just access the local VM via LookingGlass, VNC or RDP and these would communicate with other VMs in the other host via your network (you’ll need a bridged connection and you probably can’t use wifi for that, unless you do some fancy wifi bridging using relayd. Again, they don’t need to be running on the same virtualization stack to just communicate with each other.
You can control VMs on your laptop via virt-manager and then use a browser to control VMs in the proxmox host. Nothing wrong with that. Or you can use proxmox on both your laptop and PC, but I’d highly suggest not clustering them.
It might help us to understand the problem better if you describe the workflow you have and what you want to change about it.
What I’d like is to have is a mobile Proxmox server, I do not always have access to remote servers.
Developing an app in Notes and testing it needs separate instances of the Notes client and Designer, and I might also need other server or client VMs to look things up, do intermediate testing.
Since Proxmox is really efficient, and the workloads are not that heavy, a laptop will suffice.
I tried installing the VDI client, but given the install installs 140 packages, I feel I have compromised my Proxmox host. I will be resetting that host. A better alternative seems to be a container with the VDI client. I’d like to start that and be usable on the laptop depending on a certain user logging in to the host, so the laptop becomes usable as a thin debian client in which I can start the VDI_client to connect to the different VMs, or run a browser to access the proxmox host web interface.
So why not a minimal xfce / LXDE Debian installation with: https://virt-manager.org/
You can also use zfs as storage driver (never tried it):
And if really want it light weight, have you considered LXC instead of VMs?
https://wiki.debian.org/LXC
You will end up with a very “proxmox compatible” setup, but way more suitable for a laptop.
Of course the workflows are a bit different, but the underlying technologies are the same.