The use of the infinity symbol seems really confusing. I would think a circle with midnight mapped to the top and noon to the bottom would make for a considerably more natural mapping. I'd find myself confused by the twist in infinity switching up whether clockwise or counter represented the flow of time.
The problem is that people already have the 12 hour clock burned into their minds. I think the use of the infinity symbol is a good attempt because it breaks away from the normal clock visualisation but still makes simple sense.
Because when thinking about time of day, people are more likely to relate to the clocks they look at to see the time than to the sun which few people use to work out the time?
Obviously, a clock wouldn't be 24H, but none the less it starts and ends each day at the top, not the bottom.