Without timezones you'd have to know "when is noon where you are" (defining noon as the point where the sun is highest) or "what do most people start work there," either of which is the same amount of information to remember as timezone delta vs UTC.

I don't think there's particularly any advantage either way, but everyone would have to re-learn their tricks for dealing with timezones and instead learn tricks for dealing with the lack of them.