At a certain point, I believe that most of people feels like that, deep deep in their souls but social life usually leads you to agree de facto with your environment until you are a grown up.
Point is also that to live in an organised society, more or less civil, you cannot do it like they propose. There would be no time to check with what everyone agrees / or not at every moment. That seems the gate to chaos in the name of freedom.
Considering that humans are human that would be a nice excuse to skeep every obligation imposed by current laws.
Better don't.