GPU Passtrough on Linuxmint 21
Install virt-manager
sudo apt-get install virt-manager bridge-utils
Create a Linux Bridge
add the following to /etc/network/interfaces
auto enp4s0
iface enp4s0 inet dhcp
add the following to /etc/network/interfaces.d/br0
# static ip config file for br0 ##
auto br0
iface br0 inet static
address 192.168.178.10
broadcast 192.168.178.255
netmask 255.255.255.0
gateway 192.168.178.1
# If the resolvconf package is installed, you should not edit
# the resolv.conf configuration file manually. Set name server here
dns-nameservers 192.168.178.1
# If you have muliple interfaces such as eth0 and eth1
# bridge_ports eth0 eth1
bridge_ports enp4s0
bridge_stp off # disable Spanning Tree Protocol
bridge_waitport 0 # no delay before a port becomes available
bridge_fd 0 # no forwarding delay
Step 1: Enable IOMMU
edit /etc/default/grub
at the line GRUB_CMDLINE_LINUX_DEFAULT
so that it reads like
GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on iommu=pt"
Then reconfigure Grub
sudo grub-mkconfig -o /boot/grub/grub.cfg
Step 2: Tell VFIO we want to pass through the NVIDIA card
lspci -nnk
In my case the id of the GPU is 10de:17c8
and the HDMI sound output is 10de:0fb0
. Note the part beneath the GPU where it says Kernel driver in use: nouveau.
. If everything works correctly that should change by the time we're done. To flag the card for use by VFIO, create the file sudo nano /etc/
at the line modprobe.d/vfio.confdefault/grubGRUB_CMDLINE_LINUX_DEFAULT
with the contents:
softdepGRUB_CMDLINE_LINUX_DEFAULT="quiet nouveausplash pre:amd_iommu=on iommu=pt kvm.ignore_msrs=1 vfio-pci
softdep snd_hda_intel pre: vfio-pci
options vfio-pci pci.ids=10de:17c8,10de:0fb00fb0"
Then runreconfigure Grub
sudo update-initramfsgrub-mkconfig -uo to/boot/grub/grub.cfg
update the boot filesystem image with that config. You'll need to reboot at this point. To check if everything worked correctly, run lspci -nnk again and find the GPU. Beneath both of the NVIDIA devices we passed through you should see Kernel driver in use: vfio-pci
.
Step 3: Create the Windows VM without GPU passthrough
I recommend using virt-manager
and setting up a regular Windows 10 VM using the default QXL video card before trying to do any passthrough stuff. When creating the VM, make sure to select "Customize before install" and set the Firmware option to "UEFI". Create the VM and go through the Windows installer until you have a working Windows 10 installation with no GPU passthrough, then shut down the VM.
Step 5: Fix the Windows Code 43 error
This error seems to happen because the NVIDIA driver realizes that it's running inside a VM and will disable itself. Since we don't want that we need to "hide" the fact that there's a VM from the driver. KVM has a mechanism for doing that but it's not exposed in virt-manager, so we'll need to edit the XML config for the virtual machine manually. To do that, run:
sudo virsh edit win10
where win10 is the name of the VM that you gave when you created it inside virt-manager. You'll need to edit the contents of the
Inside the
<vendor_id state='on' value='1234567890ab'/>
(the actual value of the vendor_id is arbitrary, but it should be a 12 digit hex number).
Inside the
Inside the
<ioapic driver='kvm'/>
The end result should look something like:
<features>
<acpi/>
<apic/>
<hyperv>
<relaxed state='on'/>
<vapic state='on'/>
<spinlocks state='on' retries='8191'/>
<vendor_id state='on' value='1234567890ab'/>
</hyperv>
<kvm>
<hidden state='on'/>
</kvm>
<vmport state='off'/>
<ioapic driver='kvm'/>
</features>
If you boot the machine up again, the NVIDIA driver should actually work! Windows will probably default to using the GPU as the primary card, which means that the Windows login prompt will likely appear on the display connected to the video card rather than the QXL display that you can see in virt-manager.