Agree with the manager sentiment. It's their job to manage the team.

Failing that, I'd find a new job; you don't owe the company anything (literally) and you owe it to yourself to not be miserable.