That's great for people living/working with people who have a healthy respect for boundaries, but not everyone has that luxury. Boundary issues are rampant, especially in families.
Boundaries need to be enforced. That's hard to do if you shy too much from being perceived as impolite.
Everyone has a different level of conflict tolerance, of course. But letting someone know that they are being rude and disrespectful should be on the table.