Let me get this straight. So he's an "asshole" because you and possibly some other people refuse to accept that certain English words have multiple distinct definitions, and because you also refuse to take into account context when reading such words? It's a rather unusual stance to take.
I'm not refusing to accept anything. Of course words have multiple meanings, but that doesn't mean the other meanings magically disappear just because they're not implied by context.
Interpretation of natural language is strongly influenced by lexical connotations. If you use a negative word in your sentence, people will have negative reactions to it, regardless of your intent.
In practice most people who do this are merely profoundly ignorant and unsympathetic, rather than overtly being assholes. But yes, if someone intentionally choose to use words with upsetting connotations, I consider them an asshole.