And if having transient people churning through your house didn't affect your neighbours then there wouldn't be a problem. But it does.

There are numerous incidents of parties run amok, drug use, prostitution etc.