In my experience the people who have fucked me over the most have been mean bastards who like fucking people over. Some of them have worn hats, but most of them didn't and some of the folk in hats have also helped me out and I suspect most of the mean bastards in hats were mean before they even got the hat and there are a fair amount of mean bastards wondering about anyway.
But I will remember actions of a person. I've had more non-hatted folks fuck me over than the other.
Again just a single source of stats. Nothing to draw from.