Though if you want to take moral relativism seriously, you'd also have to consider if your own moral standards might be too lax and what it means if you overstep the boundaries of others.

Just saying "well who knows what's right and what's wrong anyway?" and use that as an excuse to invalidate others' objections is cheap.