I think he more meant "vote for that congressman's strongest opponent." The party doesn't particularly matter so much as showing that his handling of this specific situation caused someone to support his biggest rival.