The mains coming into your house is really only a single wire. The wire is called active.
The other wire is a metal rod pushed into the ground. This is called the neutral.
That's why touching the active and ground will kill you.
A battery is not connected to the gound. That's why you have to connect to both terminals to get a voltage reading.