Quantum computing

Have you guys ever thought about the implication of quantum computers to break encryptions?
I mean if it is 100,000,000 times faster, prime numbers used to encrypt data are just void.