In Japan, where this pet mode exists, honor and respect of social rules are something, and I doubt you would take the risk to be seen leaving an elevator in pet mode without a pet.
Some destination-dispatch systems used in high-end residential towers will not schedule pet owners and non-pet owners to the same cab at the same time. Which makes a lot of sense.