Generalization was not the thing that started racism and colonialism. The Europeans started enslaving Africans because there was a taboo against enslaving Christians, and then a bunch of BS pseudoscience combined with natural human xenophobia to make a new monster with a life of its own.

Generalization is an important tool for understanding the world. How could we think any thoughts without generalizing?