I doubt there are books that could teach you critical thinking. It requires to spend lots of time observing and learning stuff, trying out possible solutions and getting meaningful feedback.

Also from my experience it helps when you stop judging people and stuff, labeling things as good or bad, black or white. Just try to understand different points of view and outcomes as they are.