My workgroup acquired a modern workstation containing 4x RTX 3090 and sufficient RAM etc.
I want to set this machine up for multiple users to work (primarily) remote on this machine. The requirements are the following:
- Each user must be able to use 1+ GPUs
- Parallel/simultaneous computing must be possible (i.e. at least two users have to do calculations simultaneously)
- Resource quota for RAM and CPU (and GPUs)
- Remote access, SSH (a remote desktop (GUI) is a plus, but not necessary)
- 2-5 users will work on this machine (not necessarily all simultaneously)
- Each user should be able to install packages via a package manager (e.g. apt + pip)
- Adding a new environment for a user should be possible without tremendous configuration effort
- The working OS should be a Linux distro. Maybe Ubuntu for convenience.
- GPU/CUDA usage/pass-through is a must
- free/open-source would be nice, proprietary solutions also apply
I checked several options, but without proper knowledge in virtualization, it is hard to figure out the right choice.
Possible options (at my current state of knowledge):
- Host OS with docker containers for each user
- VMware ESXi (vSphere)
- KVM based solutions (e.g. oVirt, QEMU)
- Xen-based (seems to be outdated?)
I assume, in case of virtualization, it should be a type-1 hypervisor to keep overhead and performance losses low.
Is there a jack of all trades I wasn’t able to google myself?
Of course, thanks in advance!
