Hi mytholibar,
welcome to the forum.
You can make a circuit using an NE555. The circuit is called monostable multivibrator. It is non-retriggerable, meaning if the switch is left in the closed position the circuit will activate the output (Q) for the time being determined by R1 and C2. To reactivate the circuit, the switch must be toggled off and on again.
Have a look at this one. Pay a little around with R1 and C2 values - or get a datasheet containing the formula for time out calculation.
Boncuk