One thing society needs to get right is not screwing over slow thinkers from day 1. A slow thinker can sometimes generate amazing projects over remarkably short timelines, but deliver "meh" performances on standardized tests that use time pressure to fit scores to a bell curve
-
-
The problem isn't that high-scorers are bad at the thing that's being tested for, it's that there may be some or many folks scoring in the middle who are equally good or better. When you tweak items to produce a desired curve, you muddy the waters re: what the test actually tests
Show this thread -
If top scorers *are* really good *and* really fast, isn't that fine? Well, no. In the real world, cognitively-demanding work isn't a speed run. If top scorers get the best opportunities, people w/ traits preferable to speed (creativity, conscientiousness, etc.) may get pushed out
Show this thread
End of conversation
New conversation -
-
-
Is there a good book/article you can recommend to learn more about how tests are designed to fit these curves?
-
Malcolm Gladwell did a two-part podcast on the LSAT with some interviews with people who design the test: Part 1: http://revisionisthistory.com/episodes/31-puzzle-rush … Part 2: http://revisionisthistory.com/episodes/32-the-tortoise-and-the-hare … This book also covers it a bit, though it's not central: https://www.amazon.com/Measuring-Up-Educational-Testing-Really/dp/0674035216/ …
- Show replies
New conversation -
-
-
This might be a bit uncharitable. Psychometricians are looking for items with a range of difficulties that can discriminate at different levels of ability. If the distribution ends up being really right-skewed, it means your test can't tell people apart at low ability levels.
-
Conversely, if the distribution is really left-skewed, then your test is probably too easy, and you're not discriminating at high levels of ability. Time pressure is one way to push that needle, but often they really do just come up with harder questions.
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.