San Francisco is well on the way towards becoming the world's largest gated community. All property, even public spaces, will be owned by the corporations and wealthy individuals who pay the property taxes. They will try to dictate who has access to the city and what restrictions apply. The rest of us will be tourists.
What public spaces? They're all either reserved in advance for a yuppie wedding or being defecated on by untreated schizophrenics. There's just too many people for the amount of land to accommodate everyone comfortably.
Some people prefer a single family house with a yard, and some prefer to pack as many bodies as you can per square inch of land area. Density is good early in your life arc, but there are diminishing returns after you've already made a threshold of social contacts and investments.