He wrote criticisms of just about every major western belief system - if you take into account his larger body of work, saying he was anti-this or anti-that just seems disingenuous. Much of what he wrote was criticism for its own sake because that's what leads to progress.
He wanted his critiques to hit hard; he wanted to be subversive. My reading, at least, is that he wanted to teach people to be critical of highly-regarded cultural norms and morals and his writings are essentially case-studies in exactly that.
He wrote a book called The Anti-Christian. What else can you say?