You might miss other more positive or neutral messages from those people.

I don't think messages are filtered out, they are just shuffled to show you the ones first that the algorithm thinks you like best.

But if you don't check frequently enough or read long enough then it is effectively filtering out tweets that aren't near the top.