I often AM interested in a topic, I just don't want every little piece of content drivel shoved down my throat. I still want the cream of the crop to occasionally pop up in my feed.

That's the problem with marking things as not-interesting. The algorithm will wildly overreact in the opposite direction.