It's still a choice to remain with your religion. It's not a simple one, granted, but if you stick with a religion that requires you to hate or be intolerant to other people, you don't deserve that others are tolerant of your religion. Hence they can choose not to engage with you. Why would hey have to bear the burden of you picking the easy path.