Whether one gets uncomfortable hearing a statement isn't good evidence for whether that statement is correct or wrong.
This asymmetry of feelings is actually an argument in favor of not talking about some topics at work, unless all involved parties voluntarily agree to it. A less controversial but essentially equivalent example would be religion. It's widely recognized that you shouldn't spend time at work trying to invalidate your co-worker's religious views (or lack of them), unless they specifically ask you to. This applies to everything people build their identities around.
This asymmetry of feelings is actually an argument in favor of not talking about some topics at work, unless all involved parties voluntarily agree to it. A less controversial but essentially equivalent example would be religion. It's widely recognized that you shouldn't spend time at work trying to invalidate your co-worker's religious views (or lack of them), unless they specifically ask you to. This applies to everything people build their identities around.