Hello Hackitt,
Incorporate a way to reduce the device's output voltage as far down as you can, ideally to zero, before you remove your limb from the water to break the circuit. How exactly to achieve this depends on the means you are using to produce the 24v dc. One obvious way is to have an old-fashioned rheostat in series with your limbs. Measure the current in the present circuit with your limbs in place & calculate the resistance between your limbs. Construct or obtain a rheostat with say, 20 times this resistance at its maximum. Put the rheostat in circuit, with its resistance set to max. Place your limbs in the water, and gradually reduce the rheostat resistance to zero. Similarly, for shutdown, increase the rheostat resistance to max and only then withdraw your limbs from the water. Suitable rheostats are available on Fleabay.