Historically valve heaters were fed with AC directly from a transformer, there's no need for either DC or regulation. If you can't find a specific heater transformer the 6V one mentioned above should work fine.
If you valve is an old directly heated filament, like 01A, 6A3 or 6A4, then DC power to the heater will reduce hum but for modern indirectly heated cathodes AC power is fine.