Return to Level1Techs.com

Best 2019 motherboard/other options for VT-D + Linux

#1

I was unable to find any recent threads or information on this, so I’m looking for current advice.

TLDR: Which motherboards should I be looking at for good VT-D support with Linux?

Planning to build a fairly high end Linux PC, but I’d like it to have VT-D support so I can boot a fast Linux VM or a Win10 VM (mostly for software testing, including 3D/OpenGL). I’ve done this a few times with older hardware, but it never quite worked as well as I’d have liked, so I’m hoping the latest generation stuff has improved support.

I want to make VT-D and GPU passthrough a top priority this time.

Here’s my starting point, although I’m somewhat flexible:

  1. CPU: i7 9700K (would consider Ryzen but I’m uncertain about VT-D reliability)

  2. 1st GPU: NVidia 1080?

  3. 2nd GPU: 390X? Probably some AMD, since I think this helps significantly with GPU passthrough. (Please correct if I’m wrong or this has changed, I recall having to blacklist one card’s driver in the past.)

  4. Motherboard: Undecided :tired_face: , this is what I mostly need help with. It seems like Z390 motherboards are popular with this CPU, but I’m unable to find any good information to confirm VT-D will work well. If there’s another chipset that is much more reliable for VT-D… what would I be missing out on by switching to (whatever that is)? I think I’d rather not switch to a Xeon processor…

  5. Hard Drive: Not sure of brand but I definitely want a good M.2 drive for the main OS. I’m concerned about heat with these things, so I’ve been eyeing Gigabyte’s motherboards which have some “M.2 thermal guard” thing (not sure what that is yet).

Cost isn’t really an issue (I could upgrade or change GPUs if needed, etc.) but I don’t need absolute top of the line everything.

Using integrated graphics probably isn’t an option, partly because I want decent GPU performance on both the host bare-metal OS and the VM OS, but also because the monitor I use is near 4K and I anticipate problems (ex. HDMI 1.4).

Hoping to go with Linux Solus for the ‘bare metal’ host OS, and likely Mint for the guest. My typical workload is software development, but I do some gaming (Linux only). I’ve had GPU passthrough working before, but didn’t have luck with USB (of all things!), even with add-on cards.

How can I improve my odds of success this time around?

#3

VTd in intel and SVM in amd.Try x570 + ryzen 3000 series. Checkout my topic :smiley: I didnt test all the mbs but ryzen impressed me a lot.I will say it is perfect for almost all situations.I had 6700k + z270 for kvm before.And now my [email protected] may have 210% performance compare to 6700k.

wx_camera_1562683662473
wx_camera_1562683662473.jpg928×1920 235 KB

1 Like
#4

Thanks, clearly I have some research to do. Two NVidia GPUs… I wonder if that’s easier to do because I guess you did a headless setup. I hadn’t considered that option.

#5

Aha,It spent 5~10 min for linux install(copy files to disk, grub install,done.)

But the linux build is quite hard for noobs.I did it long time ago.Maybe two weeks include qemu & libvirt tests.

#6

I’ve only ever done this with a Linux host, not too worried about that. I am kind of considering a 2950X now (GB’s X399 Aorus Pro is tempting), but I’m not sure I can get over the much slower single core performance vs a 9700K. :frowning:

If I look at it compared to my current 6700K it’s a smaller gap on that metric, so maybe I can live with it.

This site https://passthroughpo.st/vfio-increments/ has me hesitating a bit with a z390 motherboard due to a kernel patch needed (for two discrete GPUs), and it doesn’t indicate that issue for X399.

I will likely need to read up on how these new AMD CPUs are doing on Linux. I’ve seen lots of “FUD” type stuff but not sure what the real story is.

I did find this awesome thread (and I think it says he used Solus too, so even more awesome), but I don’t think it has detailed instruction on what’s involved with that ACS override patch.

#7

I’ve only ever had speed-bumps with debian based distros. Fedora, Arch, Gentoo, Suse, Solus were all easy going.

1 Like
#8

A word of caution on Gigabyte’s x399 offerings. I have one the x399 Designare and my IOMMU groups are awful. Running the May 2019 Bios 12e. It seems everyone is all about passthrough these days, well, I’d pass on Gigabyte. Others claimed more success than I, so I wonder if something’s changed in the bios, or on the silicon?

1 Like
#9

What might make you become “stuck” with Intel is if anything falls into legacy code(running something pre-Ryzen such as an old personal project) in a VM can be problematic or broken when used on a Ryzen CPU–from a developer point of view, it could be useful for bug testing :thinking:

The best advice I’ll give is if you plan for reliability and stability, you’re really going to want ASUS or ASRock for a motherboard maker as they have had solid BIOS releases. (I’m not a fan of ASUS but they do push out updates to correct bugs/issues faster than others–ASRock as gotten better with updates too)

When it comes to GPUs just use whatever fits your budget, you could use a GeForce or a Quadro. Can’t say much about AMD GPUs, haven’t owned/used one for an extremely long time.

There are SSDs which aren’t as toasty such as SATA M.2 models, if you go the NVMe route you’ll just have to stick with a motherboard with an included thermal plate/heatsink or use a NVMe SSD which includes their own heatsink.

Normally I don’t like saying this, ever since Gigabyte jumped onto the RGB bandwagon via Aorus series they’ve turned into MSI :tired_face:
If you’ve ever used a Gigabyte board in a work environment their BIOS doesn’t get polished as quickly as other OEMs so your mileage varies, however some of their products have been rock solid and close to ASUS & ASRock.

#10

I’ll bite.

What could possibly make Ryzen not an acceptable option for running vms?

If you’re running bare metal, I’d get needing specific instructions, but putting a vm in the mix eliminates any concerns there.

#11

If the OP is running a current Windows and Linux in VMs there isn’t any risk of issues but I’ve seen some interesting examples of legacy OS or something which poked into something really old(ex: running Windows 8/10 32-bit to test older software or if you’re trying to migrate data). Even before Ryzen there were some interesting weirdness with Windows 8/10 32-bit on AMD CPUs, what I mean by weird is if a developer purposely coded for Intel CPUs.

#12

Right, but if you’re in a VM, setting the uarch properly means you won’t have this problem.

#13

The passthroughpo.st site is mainly what prompted the x399 Gigabyte thing (they have an Aorus Pro listed). Of course I’m not really sure how much to trust that site either…

Does anyone have experience with ASRock Z390 Taichi or another Z390 ASRock board?

#14

emmm,I’ll checkout later.Really busy ,recently

#15

Going to gamble (I guess) with these:

Core i7-9700K
AsRock Z390 Taichi LGA 1151 ATX

…and I’ll drop a spare R9 390 (Host) and 1080 (Guest) in for starters and see how that goes.

1 Like
#16

Now I have to resist the urge to install a “temporary” cheap CPU cooler so I can start with OS setup, while I wait for a Noctua to arrive Monday… that being the only important thing left to get a hold of. :grimacing:

Kinda dumb to install a heat sink I know I’ll have to remove for sure in two days…

1 Like
#17

Should be fine i guess.
You could eventually also use the igpu for the host system.
If you run into any issues according the cards.

1 Like
#18

Hi. Finding this now in November. How did you get on with that board? Would you be able to simply use the onboard graphics on the chip for the host?