Yes thats true, more so with the camera esp module, I had to put a 470u across mine to stop that, but thats all over the net, and also the esp gives an error message saying brownout, mine was saying switch reset, which really confused me.
There are some modules that dont have a pullup on the reset switch, that was one of the first things I tried.
Andreas spiess has a video on how you can use the 2 cores in the esp for what you like, normally one is confined to wifi and the other to your code.