The problem with mechanical switches is that they don't switch cleanly. They bounce, creating several pulses each time the open, and each time they close. The bounce may last for several milliseconds (or more, if it is a large switch). Fortunately, you can debounce your switch with a couple of extra components. I used 3. The 100 ohm resistor is sometimes omitted. Including it limits the switch current into the capacitor, which otherwise might be several amps for a very short time.
The output will change state when you push the button, but not when you release it. This is called toggling, which has already been discussed. Is that what you want?