6 points | by surprisetalk 3 days ago
5 comments
It would make more sense to just use IRT for grading the responses than trying to add more complexity to the answers themselves.
I seem to remember some medical related multiple choice tests in the UK use a mechanism of +1 for correct , 0 for unanswered , -1 for incorrect.
A system like that seems especially appropriate for a practice where the foundational principle is "do no harm."
Would probably be applicable to engineers as well, or any other field where the practitioner has an obligation to be aware of the limits of their competency.
https://en.wikipedia.org/wiki/Calibration_(statistics)
https://en.wikipedia.org/wiki/Scoring_rule
It would make more sense to just use IRT for grading the responses than trying to add more complexity to the answers themselves.
I seem to remember some medical related multiple choice tests in the UK use a mechanism of +1 for correct , 0 for unanswered , -1 for incorrect.
A system like that seems especially appropriate for a practice where the foundational principle is "do no harm."
Would probably be applicable to engineers as well, or any other field where the practitioner has an obligation to be aware of the limits of their competency.
https://en.wikipedia.org/wiki/Calibration_(statistics)
https://en.wikipedia.org/wiki/Scoring_rule