I strongly advise against trying to learn physics from this book. Trust me, while the idea looks magnificent in theory, it's a horrible book to try and learn from for someone who doesn't have the mathematical and physical background. It just isn't possible, and yes, even if you're very, very smart and talented. Despite the fact that theoretically it's self-contained, you really need an equivalent of a PhD in math or mathematical physics to approach this book; but if you do have that background, there are better specialized textbooks.

The whole thing is basically a massive exercise in vanity. I wouldn't be surprised if it actually were the most unread book published recently, in relative terms (that is, the most percent of people who bought it didn't end up reading any substantial part of it).