The voltage rating on a fuse is the rating that ensures circuit interupption when the fuse element opens due to an over current condition. What this means is if the normal voltage is 125 and a 250V fuse is in the circuit, upon an over current condition the fuse element may arc and not cut off the voltage to the circuit.
I would never use a 125V fuse in a 250V circuit.