If you could see the extent of organization that such a life requires, you wouldn't say that. Especially when the alternative is "I bought this place and now you have to pay to live there" which is the highest form of doing nothing.
How can that be worse than "there are millions of unoccupied places, most housing belongs to the same people who don't need it, and yet there are millions living in the street"
Most houses are owned by people who do not work for it. It's the rent from their other houses that give them even more money, effectively doing nothing. Let's not think those people deserve our praise for their parasitism.
If you could see the extent of organization that such a life requires, you wouldn't say that. Especially when the alternative is "I bought this place and now you have to pay to live there" which is the highest form of doing nothing.