do you have any background in controls or systems? any knowledge of frequency response or what a pole and/or a zero is? if not, then you're going to have trouble understanding how to properly compensate your buck regulator.
Edit: What type of circuit are you using for the control. Is it a standard switching regulator IC? They usually have standard design equations to help with calculating the loop compensation values.