Related Experiment Videos
Improving the fairness of multiple-choice questions: a literature review
1Department of Radiology, Bristol Royal Infirmary, Bristol, UK. pmccoubrie@doctors.org.uk
Abstract:
The ubiquity of multiple-choice questions (MCQs) results from their efficiency and hence reliability. Cognitive knowledge assessed by MCQ predicts and correlates well with overall competence and performance but examinees and examiners alike frequently perceive MCQ-based testing as 'unfair'. Fairness is akin to defensibility and is an increasingly important concept in testing. It is dependent on psychometric adequacy, diligence of construction, attention to consequential validity and appropriate standard setting. There is a wealth of evidence that extended matching questions are the fairest format but MCQs should always be combined with practical assessments, as written testing emphasizes learning from written sources.
Related Concept Videos
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Surveys
Equity Theory
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Halo Effect
Theory of Attribution II: Kelley's Covariation Theory