Can you make local AI useful under 1000?

Of course someone benchmarked it already :wink:

Strix Halo is newer than the RDNA3 APUs I was referring to and it looks like fast memory is being used here but 20-40 t/s sounds about right for other APU setups as well.

Ultimately, discrete GPU will be faster but limited on VRAM, APU system will be able to run bigger/better models but at a lower average token rate.

I personally prefer the faster token generation of dGPU, but having to buy a second one to fit decent models also put the budget well over $1k.

Maybe @lhl can offer some more advice about the APU setup