I can agree with him the mismatch is what makes me dislike the joke as it can spawn bad ideas but also what can make it funny in a "dark humorous" way.
Me not liking the joke doesn't necessary mean it's not funny :=/ Like a joke which makes you both laugh and feel bad at the same time...