Here's the thing: music is a lot like math. The more you practice it, the more you find yourself becoming a "natural" at it.

I used to be terrible at math. Then I found a teacher who basically made me work every day on math problems.

Within a few months, I found that I actually enjoyed maths, and was even good at it.

Of course, without natural talent you're not going to become the next Bowie, but even a bit of practice can make you surprisingly competent.