It doesn't sound very crucial then, the normal way is to use a higher voltage transformer (say 9V) and a 5V regulator IC such as a 7805 to give a regulated 5V output. In your case it might be a good idea to feed the amplifier from before the regulator to get more power from it, depending on what it is?.