I think the situation is a little more complex than this. I recommend reading https://www.cell.com/cell-host-microbe/fulltext/S1931-3128(2...

In short, we have to consider that other viruses like OC43 and HKU1 either do not have durable mucosal responses, or the response of the immune system is to slow for the viral dynamics of some viruses.