The logical conclusion of going down that route would be to dispense with the concept of time zones altogether, and just revert to using local solar time.
This is why I think we should entirely ditch the concept of timezones. Clock time, as we use it, is largely decoupled from solar time anyway, and all attempts to reconcile the two just lead to confusion.
We already have terms a few terms to tie events to solar time, for example, a park being open from dawn to dusk. And without time zones, we might come up with a few more.