Its important to understand the word majority has two different meanings. There is the mathematical majority which we are all familiar with on here but majority used in these cases is not referring to the mathematical definition of majority but the sociological definition of majority which is the group that holds [the majority of] the social power. In sociological contexts the word majority never refers to population size.
It's not that important. His point is that (neo nazis|white supremacists|whatever) are not racist as they are not part of the social majority. That's twisted.