Do you also plan to buy your home with cash only? You will need to save for a long time. To me, loans can be used to judiciously add leverage to your financial profile. If 90% LTV (loan-to-value) is too high for your personal risk profile, then you can increase the down payment from 10% to 20 or 30%.
I can quit my job with full peace of mind, that's what this whole thread is about.
If and when I have money to buy a house, I'll just buy one. It's not that different from buying a fancy meal or a plane ticket. If I have the money I might buy it. If I don't, I don't think about it. I'm simple like that, and as a result, I have very few financial worries.