I can give you an example for nvidia in my limited use. Pop OS. Pretty painless but may not for a specific use case. I could not speak for amd or specific use case.
Which is why doing some research on gpu driver support in regards to OS and use case can save you some effort and headaches.