Only if everyone is a peasant farmer with the same crops in the same place. My activities are barely related to the height of the sun in the sky, and like the other residents of my city I don't take a ton of notice of harvest time. Bus timetables and cultural festivals are a much bigger deal (of which one in particular is indeed historically related to a harvest).
My first thought as well as a swede. And coincidentally one of the things my old Kenyan classmate found the most strange about Sweden was the fact that the length of day was not even close to constant. That and when I explained to him that the sun being up doesn’t necessarily mean warmer weather, in the winter it’s practically takes the temperature further from zero as sun means no warming clouds…