At least where I am, you're not supposed to visit temples dressed liberally because it needlessly tempts the monks who have taken a vow of celibacy. Same decency would apply to priests / churches.
I'm sorry but if a lifelong commitment to your religion and completely basing your entire life and lifestyle around said religion is not enough to quell your temptation, then maybe temptation is such a fundamental, core component of being a human being that we shouldn't be trying to suppress it so aggressively in the first place.
