Yes, great point. A space engineer can feel super inadequate when it comes to systems thinking (since she/he is surrounded by geniuses) but a smart barista can feel like a 5 on the 1 to 5 scale. (Of course the barista might be better than the space engineer, but you get my point).
I've been called in to an extra meeting with my future employers because my answers on one of those. I mean, I'm pretty analytical (I'm doing my PhD in engineering this fall) however I didn't give myself top score on that (and a lot other metrics) as I know people who are a lot more analytical etc than me. After working in that company for a few years (and quit) I realize I should have maxed out on many of those metrics, but all in all its so much bias involved in those questionnaires - and I don't think the people working them are realizing that. At least most of them don't.
And that is without going into the skewing of these questions. Yes I can be motivated to do a good job without answering like this job is the most important task in my life behind breathing and in front of eating.
I've been called in to an extra meeting with my future employers because my answers on one of those. I mean, I'm pretty analytical (I'm doing my PhD in engineering this fall) however I didn't give myself top score on that (and a lot other metrics) as I know people who are a lot more analytical etc than me. After working in that company for a few years (and quit) I realize I should have maxed out on many of those metrics, but all in all its so much bias involved in those questionnaires - and I don't think the people working them are realizing that. At least most of them don't.
And that is without going into the skewing of these questions. Yes I can be motivated to do a good job without answering like this job is the most important task in my life behind breathing and in front of eating.