Maybe you can't customize notifications extensively in Slack itself (I found them okay, yet slightly lacking), but if you're on a Mac, you can definitely comfigure Desktop notifications per App, which I also did.