I would say the the catch phrase in your argument is "best friend". If the person you were describing wasn't your best friend, you might automatically focus more on the physical aspects, since you wouldn't know the intimate details of their mind.

That said, I am not advocating deliberate misuse of pronouns; I am just saying the topic may not be as simple as it seems.