Related Experiment Videos
The accuracy of standardized patient presentation
R M Tamblyn1, D J Klass, G K Schnabl
1Department of Epidemiology and Biostatistics, McGill University, Montreal, Quebec, Canada.
Medical Education
|March 1, 1991
Summary
Standardized patient performance in medical exams was evaluated. While overall accuracy was high (averaging over 90%), significant variations existed between individual standardized patients and institutions.
Area of Science:
- Medical Education
- Standardized Patient Programs
- Clinical Skills Assessment
Background:
- Standardized patients (SPs) are crucial for simulating real-world clinical scenarios in medical education.
- Evaluating the accuracy of SP clinical problem presentation is essential for the validity of high-stakes examinations.
- Previous research has not comprehensively assessed the accuracy, replicability, and portability of SP cases across institutions.
Purpose of the Study:
- To evaluate the accuracy of standardized patient clinical problem presentation in a large-scale, inter-university medical examination.
- To assess the replicability and portability of standardized patient cases across different training sites and patient cohorts.
- To identify factors influencing the accuracy of standardized patient encounters.
Main Methods:
- Videotape rating of a random sample of 839 student-patient encounters from a 1987-1988 final-year medical student examination.
- Encounters involved 88 standardized patients, 27 cases, and two university test sites: University of Manitoba and Southern Illinois University.
- Accuracy was quantified by scoring the fidelity of the standardized patient's clinical problem presentation.
Main Results:
- Average accuracy of standardized patient presentation was 90.2% in 1987 and 93.4% in 1988.
- Significant variability observed: 15 patients achieved perfect accuracy, while 11 scored below 80%, with some as low as 30%.
- Significant differences in accuracy were found between patients trained for the same case (6/35 comparisons) and between universities (5/15 cases), with Southern Illinois patients generally more accurate.
Conclusions:
- Standardized patient presentations demonstrate high overall accuracy but exhibit significant variability.
- Inter-institutional differences in accuracy suggest potential issues with case portability and training standardization.
- Further investigation into training protocols and site-specific factors is warranted to enhance the reliability of standardized patient assessments.