When you draw, it is good to have the most positive voltage on the top and the most negative at the bottom. Often inputs on one side and output on the other.
I added a second diode and a 1k resistor. When power is applied they have no function. When power is taken away the capacitor will discharge at 1K rate not the 10k rate. (10 faster) This should help your problem.