Do preceptors with more rating experience provide more reliable assessments of medical student performance?
Kristi J Ferguson1, Clarence D Kreiter, Rick D Axelson
1General Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, Iowa 52245, USA. kristiferguson@uiowa.edu
Background:
Although the existing psychometric literature provides guidance on the best method for acquiring a reliable clinical evaluation form (CEF)-based score, it also shows that a single CEF rating has very low reliability.
Purpose:
This study examines whether experience with rating students might act as a form of rater training and hence improve the quality of CEF ratings.
Methods:
Preceptors were divided into two groups based on rater experience. The univariate and multivariate G study designs used were simple rater (r)-nested-within-person (p) [r : p and r(○) : p(•)] models, and in the univariate analysis was applied separately to CEFs completed by high and low experienced raters.
Results:
The high experienced rater group yielded a substantially higher observed reliability in both the univariate and multivariate analyses.
Conclusions:
These results support the hypothesis that high experienced raters produce more reliable ratings of student performance and suggest methods for improving CEF ratings.
Related Concept Videos
Reliability and Validity
Assessment of Ventilation I: Respiratory Rate
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
Surveys
Blind Procedures
Assessment of apical radial pulse
The A-R pulse assessment involves simultaneous evaluation of the apical and radial pulses. When the apical and radial pulse rates vary, this assessment helps identify a pulse deficit.
Pre-Procedural Preparation
Nursing Evaluation
Section...

