I know what you mean. I have a couple of problems which at times make using the stairs, even for one flight, impossible. And the most I have is a slight limp most of the time.
And I hate using elevators too, I'm claustrophobic. But in some places using the stairs isn't safe.
There are plenty of reasons someone may be taking an elevator to the next floor, and not all are obvious.