Don't be so hard on yourself. "Building a business" is one of the most difficult adventures you can take in life. Stop worrying about how much time you have too, that is ridiculous. I have family friends in retirement (65+ years old) that are building incredible little niche companies. What do you want to build?