There's a real epistemological problem that people of protected classes face that I hadn't considered before reading this article and the comments here; one unintended effect of the current zeitgeist is that, because overt sexism against women is so heavily policed, almost nobody is going to be explicitly sexist against women, so women can get stuck questioning the motives behind potentially any interaction.

For those perceived as belonging to a privileged class, people feel free to (and in some cases relish in and are socially rewarded for) voicing their sexist opinions. A man has a lot less reason to dwell on whether a particular interaction was sexist against them, because when it does happen it is often overt.