It doesn't matter if you and "plenty of people" don't mind, the important part is that the majority of people do mind, and will not cycle in cold winter rain.