Looking for a cheap quiet CPU Cooler

Hello, so I am doing a quiet gaming rig in the Fractal Design Define R4, and I am looking for a cheap CPU cooler ($20 or under) to replace the very noisey stock heatsink. It doesn't need to be any better at cooling than the stock cooler but it needs to be a bit quieter. Any suggestions would be fantastic, thanks

At that budget, the 212 Evo is your best bet.

If you can stretch to ~30$ get the coolermaster hyper 212 evo, and that is a good tip, but if nothing above 20$ is a no gu, consider an older TX3 if compatible... Bear in mind that a quality cooler will have less of a struggle with your cpu and wont need to up the speed of fan, thus making less noise... so dont be that cheap and pay 32$ :D

http://bestcpucoolers.com/best-air-cpu-cooler/

For $20, you won't find anything unless you can dig around for something old at a nearby computer store or maybe a school's IT department.. Get the Hyper 212 like other people have recommended.