There are many many many more time where "doing what you love" is incorrect than times where following math is incorrect. The more we focus on math and mathematical relationships between different variables, the more accurate we get.

Do not listen to detractors IF YOU HAVE EVIDENCE SUPPORTING YOUR CAUSE, but do not blindly pursue something because of an unsupportable "gut" feeling