Of course someone benchmarked it already ![]()
Strix Halo is newer than the RDNA3 APUs I was referring to and it looks like fast memory is being used here but 20-40 t/s sounds about right for other APU setups as well.
Ultimately, discrete GPU will be faster but limited on VRAM, APU system will be able to run bigger/better models but at a lower average token rate.
I personally prefer the faster token generation of dGPU, but having to buy a second one to fit decent models also put the budget well over $1k.
Maybe @lhl can offer some more advice about the APU setup