Whatever you're using to cover the board with has a very poor dielectric breakdown voltage apparently or is otherwise directly conductive. You have to use a proper sealant, one specifically designed to withstand high voltages and make sure it's cured/set completely before testing.
4pyros suggestion you test it under load is probably good too, the no load voltage of those things should be considerably higher than it's loaded voltage.