Related Experiment Video
Updated: Jun 10, 2026

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Reliability of performance examinations: revisited
1Measurement Research Associates, Inc., 505 N. Lake Shore Dr., Ste. 1304, Chicago, IL 60611, USA. mlunz@MeasurementResearch.com
Abstract:
This article discusses the reliability for performance examinations with respect to the reproducibility of candidate pass-fail decisions. The multi-facet Rasch model accounts for the difficulty of test forms (examiners + tasks + items) taken by each candidate, so that all candidates are measured against the same criterion. The examiners provide analytic ratings of candidate performance using a defined rating scale. The examination is standardized so that sufficient information is collected about the candidates, and facets of the examination are linked. When the examination data are properly collected, there are high levels of confidence in the reproducibility of candidate outcomes for a high percentage of candidates.
Related Concept Videos
Reliability and Validity
Theory of Attribution II: Kelley's Covariation Theory
Sources of Self-Esteem II: Performance Feedback
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Self-Evaluation Maintenance Model
Uncertainty in Measurement: Accuracy and Precision
