I understand what you're saying, but the problem is that a vast and growing majority of downvotes cannot possibly be interpreted as "this doesn't contribute anything". Votes are being used like they would be used in an election. I'm for or against this. And that's just not good enough in my view.