Passing through a Xbox One Wireless Contoller to Windows 10

I am using virt-manager/kvm. If pass it through, windows recognises it, but I cant use it / the led doesnt start blinking and i cant pair a contoller. If I pass through an entire Usb-Contoller it works.
Does anyone know how I could get it to work without that?