This may well be harder to get right than just deleting the data. Just as in the saying (and this is a terrible paraphrase) goes:

  "Anyone can design a lock that they themselves can't pick"

If you think you have anonymised data sufficiently you may well not have done it sufficiently to prevent others from re-conctructing it:

https://en.wikipedia.org/wiki/AOL_search_data_leak