I had no problems installing CUDA on Windows, together with the newest Game Ready Drivers for my 3090. I only ran the examples shipped with CUDA until now, but they seemed to run perfectly well.
Profiling works with the correct privileges or options available in the Game Ready driver as well.
I only suspect that breakpointing will not work. But this is more likely when the same GPU is responsible for display output at the same time, not because of the gaming driver. The last time I tried that (with a GTX 980 ti), Windows wisely refused. Linux however, seemed to stop the whole card in its tracks which basically froze all monitors, including mouse pointer. (The system took 15 minutes to fully recover from that…)