Give people a metric - any metric - and they will (conciously or otherwise) start optimizing that instead of the actual goal.
Besides, if you're a non-technical leader it can be difficult to understand how things are going unless you have some kind of metrics to track.