Do I need a Cpu cooler?

http://pcpartpicker.com/p/s60y

No OCing 3.8 GHz is enough for me

yes

I don't think so. I believe the only CPUs you want to buy an aftermarket cooler with are the 8320 and 8350, which I've heard had terrible stock HSF