Inactivity fees are worse than that. You're not using the account? Maybe you're not paying attention to it, so we'll try to siphon some money out while you're not looking.

The least cynical take is that they're a charge because you're not letting them make money from you in other ways, and even that's totally indefensible. They don't have a divine right to make extra fees on your account.