It's not like their opinions are written on their foreheads. Hit on a woman on tinder she won't know. Hit on a woman in a bar she won't know. Clearly the rejection is for simply being unattractive.
Incels generally hate women and the progress made in Western society. Part of holding women in subjugation is painting them as superficial, and one good way to do that is to convince everyone that male attractiveness is based on a very specific facial feature as if a single dimension of the face can make up for more serious personality flaws.