Not if you're using probabilistic data structures like Count-Min[0]. You don't care about the exact count. You just want an estimate with a certain probability. Such structures only support addition, not removal.

[0] - https://en.wikipedia.org/wiki/Count%E2%80%93min_sketch