I wouldn't worry about it, just try a little harder. In the long run it doesn't really matter what your situation is today, what matters more is how you allocate your future time and how you will deal with the opportunities that come your way.

The luck element is out of control for everybody, timing you only control so much, execution and attitude you control 100%.