You could work whenever you want to and be just as efficient - but you would lose the benefit of social synchronization.

Having non-work time simultaneously with the people you want to share your life with is a huge factor in working at the same time.