In post #1 you mention a 1000 uF cap. The schematic is very difficult to decipher, but there is none that I can find on it. Also, no reference designator, so I have no idea where this capacitor is connected.
If you are talking about hanging a large value capacitor on the output, then this probably is a simple gain margin / phase margin issue. Most opamps cannot handle large capacitive loads, and this is a particular problem for circuits with a large power bandwidth, such as audio power amplifiers and voltage regulators.
Separate from that, the circuit seems very complex for the task. What are the requirements for the circuit? Min / max output voltage, min / max output current, current limiting type, etc - ?
ak