Related Experiment Video
Updated: Jul 19, 2026
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills
Melissa J Margolis1, Brian E Clauser, Monica M Cuddy
1National Board of Medical Examiners, 3750 Market Street, Philadelphia, Pennsylvania 19104, USA. mmargolis@nbme.org
Background:
Multivariate generalizability analysis was used to investigate the performance of a commonly used clinical evaluation tool.
Method:
Practicing physicians were trained to use the mini-Clinical Skills Examination (CEX) rating form to rate performances from the United States Medical Licensing Examination Step 2 Clinical Skills examination.
Results:
Differences in rater stringency made the greatest contribution to measurement error; more raters rating each examinee, even on fewer occasions, could enhance score stability. Substantial correlated error across the competencies suggests that decisions about one scale unduly influence those on others.
Conclusions:
Given the appearance of a halo effect across competencies, score interpretations that assume assessment of distinct dimensions of clinical performance should be made with caution. If the intention is to produce a single composite score by combining results across competencies, the presence of these effects may be less critical.
