Related Experiment Video
Updated: Nov 21, 2025
10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
18.8K
Psychiatry Clinical Skills Evaluation: a Multisite Study of Validity
Michael D Jibson1, Gaurava Agarwal2, Joan M Anzia2
1University of Michigan, Ann Arbor, MI, USA. mdjibson@med.umich.edu.
Summary
The clinical skills evaluation (CSE) is a valid measure of resident competency in psychiatry, showing consistent scoring across multiple programs. This evaluation is crucial for physician-patient interaction and interview skills required for board certification.
Area of Science:
- Medical Education
- Psychiatry Residency Training
- Clinical Skills Assessment
Background:
- The American Board of Psychiatry and Neurology (ABPN) mandates clinical skills evaluations (CSE) for residency certification since 2007.
- These evaluations assess physician-patient interaction, psychiatric interviews, mental status examinations, and case presentations.
- Directly observed patient interviews are a key component of the CSE.
Purpose of the Study:
- To investigate the validity of the CSE using a multisite database.
- To analyze scoring patterns and consistency across different residency programs.
- To determine the reliability of the CSE as a measure of clinical competency.
Main Methods:
- Collected 1156 CSE assessments from 4 residency programs over 6 years.
- Compared scoring patterns, score improvement, and time to meet ABPN requirements.
- Analyzed scoring patterns of individual faculty evaluators.
Main Results:
- Score distributions showed similar patterns across programs.
- Residents met ABPN standards after an average of 3.5 CSEs, typically by late postgraduate year 2.
- CSE scores correlated with training year but not with unrelated cognitive exams.
- Faculty scoring remained consistent within a moderate range.
Conclusions:
- Findings support the validity of the CSE for assessing residents' clinical skills.
- Demonstrated moderate-to-high consistency in CSE scoring across the participating programs.
- The CSE effectively measures essential clinical competencies for psychiatric certification.
