Few questions for Asus x670e Creator Proart owners (and maybe Asus Strix x670e-e also)

Operating Systems & Open Source Virtualization
1

hello
is here some owner of x670e Creator Proart board? if so allow me few questions :

  1. are u able to passthru motherboards onboard audio(some Realtek 1220) to vm?

  2. can u confirm that one of internal onboard usb controller can be passed to vm without crashing host?

  3. in bios/uefi can you choose if you want to boot using iGPU(inside ryzen cpu) OR using dedicated gpu?

  4. is bios full featured with lot of options or just fancy looking but very limited. I didn’t find any detailed bios images or videos

  5. what is boot time/post for this board ? is there memory context option or disable memory training option in bios?

Frankly I’m considering between this x670e ProArt board OR Strix x670e-e. My original 1st candidate was Strix board, but later on I read articles about design flaw in audio codec 408X, also it seems that this codec is using internaly USB, thus that can be reason why onboard USB cannot be passed at all at Strix board, last but not least Strix has only stupid old 2,5Gb NIC and I prefer 10Gbit (I have 8port 10GBit switch at home already)

thank you very much, raven4

2
  1. are u able to passthru motherboards onboard audio(some Realtek 1220) to vm?

No, unless you are willing to pass a whole lot of devices through. It is in the same IOMMU group as both nics, wifi etc.

  1. can u confirm that one of internal onboard usb controller can be passed to vm without crashing host?

Yes I can, though I switched to using evdev as I find it more convenient for input pass through

  1. in bios/uefi can you choose if you want to boot using iGPU(inside ryzen cpu) OR using dedicated gpu?

Yes, there is an option for primary gpu: iGPU or PCIe

  1. is bios full featured with lot of options or just fancy looking but very limited. I didn’t find any detailed bios images or videos

There is a bios manual on ASUS’ site. Some stuff has been added in updates and may not be in there but it should give an idea. What are you looking for specifically? It’s probably not the most fully featured OC board (but it also doesn’t pretend to be), but I’m not missing anything, except for ACS to get nicer IOMMU groups.

  1. what is boot time/post for this board ? is there memory context option or disable memory training option in bios?

Mine are really good (couple seconds?) especially since bios 0922. But I have only 32 GB of ram for now. Boot times will depend on that mostly. Though I think with newer Bios it has improved for all capacities. I think long boot due to memory training are mostly dependent on AGESA anyway, so same for all boards?

I can check for that option, but I think it only trains fully when you change certain settings, as I notice slower boots when changing any memory related settings.

3

Yes there is a memory context restore: auto/enabled/disabled. I have it on auto which seems to be enabled.

4

Great thank you Quilt for replies. My I ask you how you do/solve audio in VM if u cant passthru onboard audio ?

I also noticed recently some post somewhere that 10Gbit NIC suffers from some instability/disconnects. DO you have so issues in this matter ?

Did u generally have any issue with ProArt board ?

Thank you,
raven4

5

No real issues so far. One annoyance was the intel NIC (2.5G one) dropping to 100 Mb a few times which was solved by replugging the cable. But no actual dropouts.

I use audio via HDMI (passed through 3060) which goes to an LG C2. I use the built in speakers or a DAC that is connected to it with SPDIF.

1 Like
6

Thank you for reply.

Regarding USB, what controller were you able to pass thru ? what ports are handled by this USB controller ?

Do you have M2 disk(s) plugged in? if so how many? According to mobo manual 2x M2 are PCI bound, while other 2 are from chipset only, thus sharing bandwith …

Thank you,
raven4

7

I passed through the one in group 18:

IOMMU Group 0 00:01.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 10 00:08.3 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]
IOMMU Group 11 00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller [1022:790b] (rev 71)
IOMMU Group 11 00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge [1022:790e] (rev 51)
IOMMU Group 12 00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e0]
IOMMU Group 12 00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e1]
IOMMU Group 12 00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e2]
IOMMU Group 12 00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e3]
IOMMU Group 12 00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e4]
IOMMU Group 12 00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e5]
IOMMU Group 12 00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e6]
IOMMU Group 12 00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14e7]
IOMMU Group 13 01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] [10de:2504] (rev a1)
IOMMU Group 13 01:00.1 Audio device [0403]: NVIDIA Corporation GA106 High Definition Audio Controller [10de:228e] (rev a1)
IOMMU Group 14 02:00.0 Non-Volatile memory controller [0108]: Kingston Technology Company, Inc. Device [2646:5013] (rev 01)
IOMMU Group 15 03:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f4] (rev 01)
IOMMU Group 16 04:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 04:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 06:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f4] (rev 01)
IOMMU Group 17 07:00.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:01.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:02.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:03.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:08.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:0c.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 07:0d.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 17 08:00.0 Network controller [0280]: MEDIATEK Corp. MT7922 802.11ax PCI Express Wireless Network Adapter [14c3:0616]
IOMMU Group 17 09:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller I225-V [8086:15f3] (rev 03)
IOMMU Group 17 0a:00.0 Ethernet controller [0200]: Aquantia Corp. AQC113CS NBase-T/IEEE 802.3bz Ethernet Controller [AQtion] [1d6a:94c0] (rev 03)
IOMMU Group 17 0c:00.0 PCI bridge [0604]: Intel Corporation Thunderbolt 4 Bridge [Maple Ridge 4C 2020] [8086:1136] (rev 02)
IOMMU Group 17 0d:00.0 PCI bridge [0604]: Intel Corporation Thunderbolt 4 Bridge [Maple Ridge 4C 2020] [8086:1136] (rev 02)
IOMMU Group 17 0d:01.0 PCI bridge [0604]: Intel Corporation Thunderbolt 4 Bridge [Maple Ridge 4C 2020] [8086:1136] (rev 02)
IOMMU Group 17 0d:02.0 PCI bridge [0604]: Intel Corporation Thunderbolt 4 Bridge [Maple Ridge 4C 2020] [8086:1136] (rev 02)
IOMMU Group 17 0d:03.0 PCI bridge [0604]: Intel Corporation Thunderbolt 4 Bridge [Maple Ridge 4C 2020] [8086:1136] (rev 02)
IOMMU Group 17 0e:00.0 USB controller [0c03]: Intel Corporation Thunderbolt 4 NHI [Maple Ridge 4C 2020] [8086:1137]
IOMMU Group 17 3a:00.0 USB controller [0c03]: Intel Corporation Thunderbolt 4 USB Controller [Maple Ridge 4C 2020] [8086:1138]
IOMMU Group 17 67:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f7] (rev 01)
IOMMU Group 17 68:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f6] (rev 01)
IOMMU Group 18 04:0c.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 18 69:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f7] (rev 01)
IOMMU Group 19 04:0d.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f5] (rev 01)
IOMMU Group 19 6a:00.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD] Device [1022:43f6] (rev 01)
IOMMU Group 1 00:01.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 20 6b:00.0 Non-Volatile memory controller [0108]: Kingston Technology Company, Inc. Device [2646:5017] (rev 03)
IOMMU Group 21 6c:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Raphael [1002:164e] (rev c1)
IOMMU Group 22 6c:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Rembrandt Radeon High Definition Audio Controller [1002:1640]
IOMMU Group 23 6c:00.2 Encryption controller [1080]: Advanced Micro Devices, Inc. [AMD] VanGogh PSP/CCP [1022:1649]
IOMMU Group 24 6c:00.3 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b6]
IOMMU Group 25 6c:00.4 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b7]
IOMMU Group 26 6c:00.6 Audio device [0403]: Advanced Micro Devices, Inc. [AMD] Family 17h/19h HD Audio Controller [1022:15e3]
IOMMU Group 27 6d:00.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD] Device [1022:15b8]
IOMMU Group 2 00:01.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 3 00:02.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 4 00:02.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 5 00:02.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14db]
IOMMU Group 6 00:03.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 7 00:04.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 8 00:08.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Device [1022:14da]
IOMMU Group 9 00:08.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Device [1022:14dd]

It has some ports in the back (the ones next to the lower ethernet) and the usb 3.0 & usb-c header. Maybe some more, I did not test all of them.

Yes I have 2 NVM-E. IOMMU group 14 is my main drive on one of the pcie 5.0 slots and IOMMU Group 20 6b:00.0 which is in one of the chipset ones. That is a cheaper Kingston NV2 so bandwidth should be fine. That is also the one I pass through to a Windows VM. Obviously you wouldn’t want to RAID the chipset NVM-E’s, and the fourth slot gets only 2 lanes if you use the 3rd pcie slot. But I don’t see that as a big limitation. More annoying is that the third slot is only x2; I would have preferred a x4 really, even if it would come at the cost of the 4th NVM-E

8

Hello and great thank you for all your time and replies.
Please allow few more questions …

USB:
if i got your point then USB controler in your gr.18 handles also the only one internal USBC header - thats unfortunate for me as I use it in Linux… So is it posible to pasthru any of other USB controllers? eg your gr. 24 or 25 or 27 ?

AUDIO:
i checked your iommu groups and found 3 audio devices -
gr 13 is dGPU NVIDIA. But there are 2 other audio devices - gr.22 + gr.26, so which one represents mainboard audio ALC1220 ? I dont see any audio in biggest gr. 17 (possibly 2nd promory/chipset). So why u mentioned that main audio cannot be passedthru. Please can u clarify this? Am I missing something regarding audio ?

Great thank you,
raven4

9

I just gave it a try and I can pass through the audio. One of them is HDMI audio and one of them seems to be the onboard jacks (though I only tested the front panel audo, think it is the same though).

I had never tried it before as I assumed all of the 6c:XX devices were associated with the iGPU that I could not pass through when I tried that (I tried then to pass all the 6c:XX devices and just had an instant reboot).

I could also pass through 6c:00.4 USB controller [0c03]. It is the top right on the Motherboard IO (port 21 in the manual). I could pass 6c:00.3 too, but could not find the port(s), possibly it is an onboad 2.0 header that I cannot use; though there may be a way to connect it to a pci bracket?

6d:00 cannot be passed through; it just reboots instantly.

10

I have a ROG Crosshair X670E Extreme, but the hardware seems configured almost identically. I too cannot pass the VGA without the whole system instantly resetting (with or without the audio device.

23. 1 device(s)
    * [1002:164e] [R] 6d:00.0  VGA compatible controller        Device 164e
24. 1 device(s)
    * [1002:1640] [R] 6d:00.1  Audio device                     Device 1640

At first, i thought I also had to pass the Thunderbolt controller, but seeing how the Proart is affected similarly, it seems like a different issue.

11

You can also use this:

12

So it is impossible to passthrough the nics individually?
(for pfsense)

13

You can look at the ACS override for the kernel, but otherwise not. ACS has some potential downsides w.r.t. memory safety (which I don’t fully understand the consequences of).

A pcie nic would work however. Or you could pass all devices in group 17.

1 Like
14

My perference:
b650 proart (only $269) > strix b650e-e ($350) >strix x670e-e > x670e proart

x670e proart is really not built for vfio/server. 2 nics, intel thunderbolt/usb4 controller. Those look great on paper. However, nics without sriov support are useless for vfio. All those features take away precious pcie lines, and no benefit for vfio. Also, you can see everything coming out of the chipset are usually in the same iommu group, which make it imposible to passthrough. Nevertheless, the last pcie slot only support x2 mode.

Because of all the reasons above, I bought MSI x670e Carbon instead. At that time back in Oct 2022, b650 proart was not in stock yet.
Here is my iommu group of MSI x670e Carbon. Primary GPU on the 1st PCIE. Intel x540-t2 on the 2nd PCIE, with vfs enabled.

Group 0:        [1022:14da]     00:01.0  Host bridge                              Device 14da
Group 1:        [1022:14db] [R] 00:01.1  PCI bridge                               Device 14db
Group 2:        [1022:14db] [R] 00:01.2  PCI bridge                               Device 14db
Group 3:        [1022:14db] [R] 00:01.3  PCI bridge                               Device 14db
Group 4:        [1022:14da]     00:02.0  Host bridge                              Device 14da
Group 5:        [1022:14db] [R] 00:02.1  PCI bridge                               Device 14db
Group 6:        [1022:14db] [R] 00:02.2  PCI bridge                               Device 14db
Group 7:        [1022:14da]     00:03.0  Host bridge                              Device 14da
Group 8:        [1022:14da]     00:04.0  Host bridge                              Device 14da
Group 9:        [1022:14da]     00:08.0  Host bridge                              Device 14da
Group 10:       [1022:14dd] [R] 00:08.1  PCI bridge                               Device 14dd
Group 11:       [1022:14dd] [R] 00:08.3  PCI bridge                               Device 14dd
Group 12:       [1022:790b]     00:14.0  SMBus                                    FCH SMBus Controller
                [1022:790e]     00:14.3  ISA bridge                               FCH LPC Bridge
Group 13:       [1022:14e0]     00:18.0  Host bridge                              Device 14e0
                [1022:14e1]     00:18.1  Host bridge                              Device 14e1
                [1022:14e2]     00:18.2  Host bridge                              Device 14e2
                [1022:14e3]     00:18.3  Host bridge                              Device 14e3
                [1022:14e4]     00:18.4  Host bridge                              Device 14e4
                [1022:14e5]     00:18.5  Host bridge                              Device 14e5
                [1022:14e6]     00:18.6  Host bridge                              Device 14e6
                [1022:14e7]     00:18.7  Host bridge                              Device 14e7
Group 14:       [10de:2782] [R] 01:00.0  VGA compatible controller                Device 2782
                [10de:22bc]     01:00.1  Audio device                             Device 22bc
Group 15:       [8086:f1aa] [R] 02:00.0  Non-Volatile memory controller           Device f1aa
Group 16:       [8086:1528] [R] 03:00.0  Ethernet controller                      Ethernet Controller 10-Gigabit X540-AT2
Group 17:       [8086:1528] [R] 03:00.1  Ethernet controller                      Ethernet Controller 10-Gigabit X540-AT2
Group 18:       [1022:43f4] [R] 04:00.0  PCI bridge                               Device 43f4
Group 19:       [1022:43f5] [R] 05:00.0  PCI bridge                               Device 43f5
Group 20:       [1022:43f5] [R] 05:04.0  PCI bridge                               Device 43f5
Group 21:       [1022:43f5] [R] 05:05.0  PCI bridge                               Device 43f5
Group 22:       [1022:43f5] [R] 05:06.0  PCI bridge                               Device 43f5
Group 23:       [1022:43f5] [R] 05:07.0  PCI bridge                               Device 43f5
Group 24:       [1022:43f5] [R] 05:08.0  PCI bridge                               Device 43f5
                [1022:43f4] [R] 0b:00.0  PCI bridge                               Device 43f4
                [1022:43f5] [R] 0c:00.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:05.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:06.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:07.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:08.0  PCI bridge                               Device 43f5
                [1022:43f5]     0c:0c.0  PCI bridge                               Device 43f5
                [1022:43f5]     0c:0d.0  PCI bridge                               Device 43f5
                [10ec:8125] [R] 0e:00.0  Ethernet controller                      RTL8125 2.5GbE Controller
                [1022:43f7] [R] 12:00.0  USB controller                           Device 43f7
USB:            [1462:7d70]              Bus 001 Device 002                       Micro Star International MYSTIC LIGHT
USB:            [1d6b:0002]              Bus 001 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 002 Device 001                       Linux Foundation 3.0 root hub
                [1022:43f6] [R] 13:00.0  SATA controller                          Device 43f6
Group 25:       [1022:43f5]     05:0c.0  PCI bridge                               Device 43f5
                [1022:43f7] [R] 14:00.0  USB controller                           Device 43f7
Group 26:       [1022:43f5]     05:0d.0  PCI bridge                               Device 43f5
                [1022:43f6] [R] 15:00.0  SATA controller                          Device 43f6
Group 27:       [8086:f1aa] [R] 16:00.0  Non-Volatile memory controller           Device f1aa
Group 28:       [1002:164e] [R] 17:00.0  VGA compatible controller                Device 164e
Group 29:       [1002:1640] [R] 17:00.1  Audio device                             Device 1640
Group 30:       [1022:1649]     17:00.2  Encryption controller                    VanGogh PSP/CCP
Group 31:       [1022:15b6] [R] 17:00.3  USB controller                           Device 15b6
USB:            [0764:0501]              Bus 005 Device 003                       Cyber Power System, Inc. CP1500 AVR UPS
USB:            [1d6b:0002]              Bus 005 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 006 Device 001                       Linux Foundation 3.0 root hub
Group 32:       [1022:15b7] [R] 17:00.4  USB controller                           Device 15b7
USB:            [0930:1400]              Bus 007 Device 002                       Toshiba Corp. Memory Stick 2GB
USB:            [1d6b:0002]              Bus 007 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 008 Device 001                       Linux Foundation 3.0 root hub
Group 33:       [1022:15e3]     17:00.6  Audio device                             Family 17h (Models 10h-1fh) HD Audio Controller
Group 34:       [1022:15b8] [R] 18:00.0  USB controller                           Device 15b8
USB:            [1d6b:0003]              Bus 010 Device 001                       Linux Foundation 3.0 root hub
USB:            [1d6b:0002]              Bus 009 Device 001                       Linux Foundation 2.0 root hub
Group 35:       [8086:1515] [R] 03:10.1  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 36:       [8086:1515] [R] 03:10.3  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 37:       [8086:1515] [R] 03:10.5  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 38:       [8086:1515] [R] 03:10.7  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 39:       [8086:1515] [R] 03:11.1  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 40:       [8086:1515] [R] 03:11.3  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 41:       [8086:1515] [R] 03:11.5  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 42:       [8086:1515] [R] 03:11.7  Ethernet controller                      X540 Ethernet Controller Virtual Function

PS:
For onboad audio, in my case, it is a USB onboard audio. I just passthrough the parent USB controller. By doing so, I also get 4 USB ports passed through along with the audio device. I can use them for keyboard and mouse.

5 Likes
15

That looks amazing! I was eyeing the MSI carbon too but couldn’t find much info on it when I built my system. This looks like the best vfio board I’ve seen so far. It has the possibility of having x8/x8/x4 pcie, right?

16

Hello jxdking,
thank you also for your input. Your info sounds interesting, because at Reddit I have multiple posts and chats with owners of Strix x670e-e (also ALC408x audio codec via USB) and they literally mentioned that they COULDNT passthru any of onboard USB controllers, any such attempt always led to host reset…we speculated that reason for that was truly some “hidden” device(s) which internaly uses those USB controlers… there were ideas that it could be iGPU or onboard audio.

Now back to your MSI carbon, can you pls provide more info which USB controller(s) you can passthru, which ports (IO shield/internal headers) are managed by such controller and most important for me how would you than setup libvirt(virt-manager) to passthu such USB controller including onboard ALC40xx audio. Does this capability(+IOMMU groups) differ/vary with different mobo firmwares in time ?

You also mentioned you use this mobo since Oct 2022? So what issue did you have this board sofar?
Also I saw posts that ALC40xx codec has some internal/design flaw that result in bad sound/cracking/unexpected noises… Did u encounter such issues?

What are your boot times and memory training times ?

Great thank you,
raven4

17

The 3rd pci-e slot is connected to chipset. It shares iommu group 24. All the vfs would be in the same iommu group 24. That’s no good.
1st slot and 2nd slot are all x8, and work flawlessly.
Also there is bug that 3rd pcie slot does not detect some pcie x1 device. MSI MPG X670E CARBON WIFI - PCIe slot no longer works after BIOS update. It seems fine with pciex4 devices for me.

18

I am on the latest bios v16. I don’t notice iommu group changes after update bios. It should not be an issue, as I can update vm configure easily.
I shut down the vm to expose some more usb devices that I passed through.
Devices that I passed through (marked with “-->”):

Group 14:    -->[10de:2782] [R] 01:00.0  VGA compatible controller                Device 2782
             -->[10de:22bc]     01:00.1  Audio device                             Device 22bc
...
Group 25:       [1022:43f5]     05:0c.0  PCI bridge                               Device 43f5
             -->[1022:43f7] [R] 14:00.0  USB controller                           Device 43f7
USB:            [0db0:d6e7]              Bus 003 Device 006                       Micro Star International USB Audio
USB:            [0e8d:0616]              Bus 003 Device 005                       MediaTek Inc. Wireless_Device
USB:            [046d:c52f]              Bus 003 Device 004                       Logitech, Inc. Unifying Receiver
USB:            [046d:c31c]              Bus 003 Device 003                       Logitech, Inc. Keyboard K120
USB:            [046d:c24f]              Bus 003 Device 002                       Logitech, Inc. G29 Driving Force Racing Wheel [PS3]
USB:            [1d6b:0002]              Bus 003 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 004 Device 001                       Linux Foundation 3.0 root hub

Full picture.

Group 0:        [1022:14da]     00:01.0  Host bridge                              Device 14da
Group 1:        [1022:14db] [R] 00:01.1  PCI bridge                               Device 14db
Group 2:        [1022:14db] [R] 00:01.2  PCI bridge                               Device 14db
Group 3:        [1022:14db] [R] 00:01.3  PCI bridge                               Device 14db
Group 4:        [1022:14da]     00:02.0  Host bridge                              Device 14da
Group 5:        [1022:14db] [R] 00:02.1  PCI bridge                               Device 14db
Group 6:        [1022:14db] [R] 00:02.2  PCI bridge                               Device 14db
Group 7:        [1022:14da]     00:03.0  Host bridge                              Device 14da
Group 8:        [1022:14da]     00:04.0  Host bridge                              Device 14da
Group 9:        [1022:14da]     00:08.0  Host bridge                              Device 14da
Group 10:       [1022:14dd] [R] 00:08.1  PCI bridge                               Device 14dd
Group 11:       [1022:14dd] [R] 00:08.3  PCI bridge                               Device 14dd
Group 12:       [1022:790b]     00:14.0  SMBus                                    FCH SMBus Controller
                [1022:790e]     00:14.3  ISA bridge                               FCH LPC Bridge
Group 13:       [1022:14e0]     00:18.0  Host bridge                              Device 14e0
                [1022:14e1]     00:18.1  Host bridge                              Device 14e1
                [1022:14e2]     00:18.2  Host bridge                              Device 14e2
                [1022:14e3]     00:18.3  Host bridge                              Device 14e3
                [1022:14e4]     00:18.4  Host bridge                              Device 14e4
                [1022:14e5]     00:18.5  Host bridge                              Device 14e5
                [1022:14e6]     00:18.6  Host bridge                              Device 14e6
                [1022:14e7]     00:18.7  Host bridge                              Device 14e7
Group 14:       [10de:2782] [R] 01:00.0  VGA compatible controller                Device 2782
                [10de:22bc]     01:00.1  Audio device                             Device 22bc
Group 15:       [8086:f1aa] [R] 02:00.0  Non-Volatile memory controller           Device f1aa
Group 16:       [8086:1528] [R] 03:00.0  Ethernet controller                      Ethernet Controller 10-Gigabit X540-AT2
Group 17:       [8086:1528] [R] 03:00.1  Ethernet controller                      Ethernet Controller 10-Gigabit X540-AT2
Group 18:       [1022:43f4] [R] 04:00.0  PCI bridge                               Device 43f4
Group 19:       [1022:43f5] [R] 05:00.0  PCI bridge                               Device 43f5
Group 20:       [1022:43f5] [R] 05:04.0  PCI bridge                               Device 43f5
Group 21:       [1022:43f5] [R] 05:05.0  PCI bridge                               Device 43f5
Group 22:       [1022:43f5] [R] 05:06.0  PCI bridge                               Device 43f5
Group 23:       [1022:43f5] [R] 05:07.0  PCI bridge                               Device 43f5
Group 24:       [1022:43f5] [R] 05:08.0  PCI bridge                               Device 43f5
                [1022:43f4] [R] 0b:00.0  PCI bridge                               Device 43f4
                [1022:43f5] [R] 0c:00.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:05.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:06.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:07.0  PCI bridge                               Device 43f5
                [1022:43f5] [R] 0c:08.0  PCI bridge                               Device 43f5
                [1022:43f5]     0c:0c.0  PCI bridge                               Device 43f5
                [1022:43f5]     0c:0d.0  PCI bridge                               Device 43f5
                [10ec:8125] [R] 0e:00.0  Ethernet controller                      RTL8125 2.5GbE Controller
                [1022:43f7] [R] 12:00.0  USB controller                           Device 43f7
USB:            [1462:7d70]              Bus 001 Device 002                       Micro Star International MYSTIC LIGHT
USB:            [1d6b:0002]              Bus 001 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 002 Device 001                       Linux Foundation 3.0 root hub
                [1022:43f6] [R] 13:00.0  SATA controller                          Device 43f6
Group 25:       [1022:43f5]     05:0c.0  PCI bridge                               Device 43f5
                [1022:43f7] [R] 14:00.0  USB controller                           Device 43f7
USB:            [0db0:d6e7]              Bus 003 Device 006                       Micro Star International USB Audio
USB:            [0e8d:0616]              Bus 003 Device 005                       MediaTek Inc. Wireless_Device
USB:            [046d:c52f]              Bus 003 Device 004                       Logitech, Inc. Unifying Receiver
USB:            [046d:c31c]              Bus 003 Device 003                       Logitech, Inc. Keyboard K120
USB:            [046d:c24f]              Bus 003 Device 002                       Logitech, Inc. G29 Driving Force Racing Wheel [PS3]
USB:            [1d6b:0002]              Bus 003 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 004 Device 001                       Linux Foundation 3.0 root hub
Group 26:       [1022:43f5]     05:0d.0  PCI bridge                               Device 43f5
                [1022:43f6] [R] 15:00.0  SATA controller                          Device 43f6
Group 27:       [8086:f1aa] [R] 16:00.0  Non-Volatile memory controller           Device f1aa
Group 28:       [1002:164e] [R] 17:00.0  VGA compatible controller                Device 164e
Group 29:       [1002:1640] [R] 17:00.1  Audio device                             Device 1640
Group 30:       [1022:1649]     17:00.2  Encryption controller                    VanGogh PSP/CCP
Group 31:       [1022:15b6] [R] 17:00.3  USB controller                           Device 15b6
USB:            [0764:0501]              Bus 005 Device 003                       Cyber Power System, Inc. CP1500 AVR UPS
USB:            [1d6b:0002]              Bus 005 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 006 Device 001                       Linux Foundation 3.0 root hub
Group 32:       [1022:15b7] [R] 17:00.4  USB controller                           Device 15b7
USB:            [0930:1400]              Bus 007 Device 002                       Toshiba Corp. Memory Stick 2GB
USB:            [1d6b:0002]              Bus 007 Device 001                       Linux Foundation 2.0 root hub
USB:            [1d6b:0003]              Bus 008 Device 001                       Linux Foundation 3.0 root hub
Group 33:       [1022:15e3]     17:00.6  Audio device                             Family 17h (Models 10h-1fh) HD Audio Controller
Group 34:       [1022:15b8] [R] 18:00.0  USB controller                           Device 15b8
USB:            [1d6b:0003]              Bus 010 Device 001                       Linux Foundation 3.0 root hub
USB:            [1d6b:0002]              Bus 009 Device 001                       Linux Foundation 2.0 root hub
Group 35:       [8086:1515] [R] 03:10.1  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 36:       [8086:1515] [R] 03:10.3  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 37:       [8086:1515] [R] 03:10.5  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 38:       [8086:1515] [R] 03:10.7  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 39:       [8086:1515] [R] 03:11.1  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 40:       [8086:1515] [R] 03:11.3  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 41:       [8086:1515] [R] 03:11.5  Ethernet controller                      X540 Ethernet Controller Virtual Function
Group 42:       [8086:1515] [R] 03:11.7  Ethernet controller                      X540 Ethernet Controller Virtual Function

I had been on windows until this Feb. I got stability issue (faulty ram). That’s why I hesitated to convert it to vfio build. The ram got replaced and everything has been fine since that.
The board is physically solid. I run (64gb+32gb) at 5600MT/s. I believe I can run 128gb at 5600MT/s just fine. It may vary with cpu lottery.
Regarding audio, I never had issue with the sound in vm (no cracking).

It is very very long. My suggestion is “Don’t reboot”. MSI seems to be slowest regarding boot time.

19

BIOS is very full featured. Even has AI-managed overclocking that trains over time. Seems to be have everything my last top-end Intel board though this board lacks some of the hardware.

20

Hello
I finally upgraded to AM5, so i choose Ryzen 7950X, Asus x670e Creator ProArt, RAM Corsair 64GB KIT DDR5 6600MHz CL32 Vengeance Black (XMP not expo), CPU cooler ARCTIC Liquid Freezer II 280.

My general feelings from AM5 platform are mixed, I encountered some more or less obvious issues, but most of my frustration comes from ProArt board. I eventually solved all issues but if i compare total costs of previous upgrade(AM4) and now AM5 I feel sad.

Regarding ProArt board…
pros:

  • cheapest mobo with 10Gbit NIC (I needed it)
  • USB4/Thunderbolt - I dont use it, but it’s addition USB-C ports
  • I can pass up to 3 USB controllers (u can generally have up to 3x 10Gbit USBs at ioshield + all internal USB2/3 + USBC headers
  • I can pass onboard audio
  • 5-10 sec boot-time (time to GRUB) IF mem.training is DISABLED (MemoryContextRestore ENABLED, no any crash/reboot sofar)

cons:

  • strange behavior of BIOS (I’ll describe later)
  • insane voltage values (SoC, …) when u enable XMP (I set many of them rather manually to prevent CPU/MOBO burnout)
  • chipsets heatsink extremely hot (60-70C in openspace = not in PC case) - it is placed exactly below GPU card so it basically warms up your GPU
  • EDIT 2023-05-10 chipsets heatsink: added few 140mm fans to case to provide better airflow, after that chipset max. reported temp 57C after 4h of Y-Cruncher stress test
  • 10GBit ethernet under same heatsink as VRMs thus 10GBit eth got hot (70C) when CPU is busy
  • EDIT 2023-05-10 10GBit ethernet: even with addional fans, NIC temperature reported up to 69C
  • 3rd slot - anything inserted here will appear in huge IOMMU group, so cannot be passed at all
  • missing CMOS clear button, start/reset buttons on mobo, NO DEBUG leds, for such huge overpriced mobo I would expect it (my previous X570 MEG UNIFY costed much less and overall feeling from MEG was much better at that time)
  • very long memory training (~1min)

BIOS issues:

  1. after purchase I configured manually as much values as possible in BIOS, made multiple hours stress (CB23, Y-cruncher, PRIME95) and after few hours system was stable…
  2. I decided to save BIOS profile to slot and just for sure saved it also to USB stick
  3. I intentionally cleared whole CMOS (battery off)
  4. I entered blank BIOS and loaded previously saved profile, right after system was absolutely unstable, many resets during CB. So i started again from scratch and set all manually, tested, added more BIOS stuff until I reached the same state as it was saved in previous round of testing. System was rock solid stable again, I again saved BIOS profile to new slot + to USB stick
  5. I intentionally cleared whole CMOS (battery off)
  6. I loaded saved profile and system was unstable again

This i repeated 3x totaly to verify that ASUS is retarded company and BIOS higly probably uses some “AI” learning feature or something HIDDEN what influences system stability BUT IT IS NOT SAVED TO PROFILE WHEN U SAVE BIOS PROFILE TO SLOT OR USB STICK…all this magical stuff behind the scene is lost during clear CMOS and system becomes unstable again

I eventually sorted this out, seems that biggest difference is LLC, BIOS in default says it uses LLC5, but I was NEVER able to have stable with LLC5 after clear CMOS (magically it was working after few hours of testing/crashing)
Then I manually set LLC to 3 and later 4, and save BIOS to another slot + USB stick, then eventually I was able to get stable system after each clear CMOS

I wasted by this almost 5days, because BIOS obviously sometimes show incorrect/misleading info and it is trully prefered to set as much as possible manually
(I used latest BIOS at the time of purchase 1202)

Short info to RAM Corsair Vengeance 64GB 6600Mhz CL2:

  • yes it is XMP not expo, but i chose it for very low CL32 (not sure why but in my country CZE/EU i can buy only buy slower EXPO kits only with CL36 or CL40, 6000Mhz)
  • Its Hynix A-die kit
  • I used buildzoid YT video to configure second.timing parameters manually… it works
  • currently I’m running it as CL32 6000Mhz with lowered voltage
  • EDIT 2023-05-10: currently at CL30-36-36, 6000Mhz, 1.3V, I’ve been running it for few days with with setup + MemoryContextRestore:ENABLED - I had no any even single crash/reboot

Short comment to 7950X:

  • its veery powerfull CPU
  • I set manually max temp to 85C, you lost ~1-2% in CB23 in comparrision with keeping it default to 95C
  • if you also set PPT to 140W i got lower temps almost by 15-20C !!! with 4% score lost CB23 only
  • atm I use settings max temp 85C + PPT 160W, performance lost is negligible and temps lower by 10C ( ~ 70C in CB32, up to 85C in Y-Cruncher)
  • didnt try to overclock, just played with Curve Optimizer (-15 allcore), LLC4, PPT and max.temp

Feel free to ask/comment

BR, raven4

4 Likes