That still wouldn't be useful. The root problem is that a scoring system that isn't infinite both ways (or the reasonably achievable scores are significantly farther from the bounds than the variance of guesses) will end up with a "clipping" at the edges of the model.
There are ways to fix this:
- Throw out the extreme high and low ends of the data bc the model breaks down there. (Which results in a very boring result)
- Have people guess their score and a rough level of confidence along side it (just a 0-5 sort of thing) and see what happens.
Note that I actually do think from my own experience that the effect is real, but the arguments presented fail to prove it statistically bc the model breaks down at the extreme where the effect is detected.
There are ways to fix this:
- Throw out the extreme high and low ends of the data bc the model breaks down there. (Which results in a very boring result)
- Have people guess their score and a rough level of confidence along side it (just a 0-5 sort of thing) and see what happens.
Note that I actually do think from my own experience that the effect is real, but the arguments presented fail to prove it statistically bc the model breaks down at the extreme where the effect is detected.