Yup, it doesn’t get rescheduled and you slowly lose influence and find yourself working on things you hate, getting bad reviews and eventually getting fired/leaving because you hate your job
Many people have to adapt to working across different timezones in their jobs. Obviously to the degree that something like that becomes a continuous pattern you need to decide if it's worth it to you to adapt to that schedule or not. There's nothing inherently "ridiculous" about it. For example I have a friend in Hawaii who has an agency with West Coast clients and she just adapts her waking schedule accordingly.