I strongly recommend to use a regulator with 100nF capacitors. The regulator type depend from desired current, because when wall-adapter can't supply enough voltage on desired current, the regulator can't work properly. First measure the load current with another 9V supply. Test with same (resistor) load the adapter, and measure the output voltage under load. For normal regulator input voltage need min.2V higher as output.
If the voltage under test lower, apply an LDO regulator, it can work with 0.3...0.5V in-out difference.