Hi there Ratchet,
Yes you can say that, but then when you say "physics" you're talking about the PN junction itself, not about the diode as a whole. So you're still applying some physics yet ignoring other physics.
A better illustration maybe...
You have a diode with a PN junction aboard a spacecraft 1 light year away from Earth. Assuming a radio signal travels at the speed of light, how long does it take to forward bias a PN junction from the ground base on Earth (by pressing a button which energizes a circuit which sends out the signal that eventually reaches the spacecraft). The answer is about 1 year. Now why didnt the voltage of the button affect the PN junction immediately? Because we had other physics to consider. And this 'other' physics we had to consider was not too trivial to the application, it was paramount. It took a whole year vs microseconds on Earth.
So it appears that you want to isolate the discussion to focus on the PN junction alone, the theory behind it. That's ok i guess, but it is a little removed from reality because we always have other things to consider when we talk about an *actual* physical device. As im sure you know, we have inductance and capacitance across and though all distances, no matter how short. And we also have resistance too. So we've always got time constants to think about.
Also, is there any proof that voltage alone can perform some function in a solid state device like a PN junction? Once the voltage gets there it's too late, because then we've already seen the power dissipated and that event is over. Once the event is over we cant say that the voltage did it because that would be leaving out what happened just before that, which is also part of the picture. The 'theory' will ignore this physical aspect because theories are there to do just that, ignore some things and concentrate on other things so that our understanding can come more immediately. If we had to concentrate on voltage and current at the same time it would be a more difficult learning process, and would also impede some design procedures.
I tried to give another example removed from the present discussion, based on magnetics. If we generate a magnetic field we need current but not voltage, but as soon as that magnetic field starts to do anything we can call physical (like pick something up or push something) then some energy has to be expended. We can say that the current caused the magnetic field and maintains the magnetic field, but if the magnetic field operated on something it would require at least some voltage otherwise we'd have an efficiency of over 100 percent.
For example, say we have a magnetic field generated by a current and that field squeezes a conducting strip made of semi conductive foam tighter and tighter. As the foam compresses the conductance goes up more and more. Thus, a current flows through the strip from end to end that increases with the magnetic field.
Did the current causing the magnetic field control the current through the strip? Yes, but without the voltage needed to overcome the resistance in the magnetic coil we could not have generated the field. So some energy was expended in the coil. How about if we use a superconductor? If we use a superconductor then we are just introducing another block in the control scheme, where whatever controls the current in the superconductor has to dissipate energy, or we have to move the superconductor closer to the strip (as an alternate to changing the current) but that takes energy too.
So it appears that you are talking about PN junction theory, removed from an actual device, but the actual device doesnt behave that way. And even with the PN junction alone some energy has to be applied to get anything to happen therefore it can not be solely controlled by voltage. The only thing controlled solely by voltage is the theory
BTW, if anything was truly controlled by voltage alone, then that same voltage would be able to control an infinite number of said devices.