I believe will cover what Mike is getting at. Too oftebn we just assume the circuit will have a bypass cap and never give it a thought. You want a bypass cap (typically .1 uF) just as close as you can get it to your power pin on the u-controller. The link will give you a good overview.
Ron
Ron