You might think so, but in reality, what happens is people say this publicly and then try to befriend the bully privately to get favourable treatment.

I'm not saying that it's right, it's just an observation.