Math is used as an IQ filter in the education system so even the people who are capable of it develop a hate for it.

The math department at my university was viewed very negatively because of this. People doing CS prerequisites and whatnot knew that they weren't there to learn but just to pass a glorified IQ test.