The initial analogy with physical attractiveness is broken. Physical attractiveness is akin to the intelligence you're born with. You may not be able to boost your intelligence much, but you CAN minimize the factor luck plays in you realizing your potential afforded to you by your intelligence.