It's a slippery slope from generalization to prejudice to racism. Each little step "makes sense" and is innocuous enough. We take many little steps and then we wind up far away from where we started off with.