You used to be able to get rid of this (or at least dramatically reduce it) by turning off "ignore accidental input". Sadly, 10.7 doesn't appear to have an equivalent, at least in the UI.

Changing that option changed a lot. I loved it. But 10.7 is a bit better at managing it than it used to be, or it feels that way to me, so I don't mind as much as I did.