From your description, it sounds like an old vertical can type with both capacitors inside the single can. This may be a problem to replace directly but the parts are available individually. One source:
**broken link removed**
has them in the Panasonic TS series for around $5 each.
Another source is TV repair shops that have been around awhile - if you can even find one - there aren't many repair shops anymore.
I'm betting you have a loud hum, leaking capacitors (waxy goo at the base) - maybe both. As you repair the unit, you might also check a large resistor in the same area as the capacitor - sometimes they also blow. Please remember that capacitors store lots of power and should be handled carefully.