So instead of solving the actual problem, you scale it up by bringing even more racism but now against whites, because now their vote is not as worthy as other groups, and now polarizing people even more by bringing more significance to the fact that someone may belong to another group.

Imagine a classroom of students, where the teacher says "the black student is not like the rest of you, but he is not the same with you. His vote is worth more." How would you imagine that would go? Why would you think that this is not equally racist?