Related Experiment Video
Updated: May 31, 2026
10:32
Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
Simulation in pediatrics: the reliability and validity of a multiscenario assessment
Mary E McBride1, William B Waldrop, James J Fehr
1Department of Pediatrics, Washington University School of Medicine, St Louis, MO 63110, USA.
Pediatrics
|July 13, 2011
Summary
This study developed a reliable pediatric crisis simulation assessment for resident training. Experienced residents outperformed interns, indicating construct validity for evaluating diagnostic and management skills.
Area of Science:
- Medical Education
- Pediatric Emergency Medicine
- Simulation-Based Training
Background:
- Pediatric residents require effective training in managing acute conditions.
- Current assessment methods may not fully capture diagnostic and management skills in simulated pediatric crises.
Purpose of the Study:
- To develop and validate a multiple-scenario assessment inventory for pediatric crises.
- To evaluate the reliability and validity of resident scores from simulated scenarios.
- To provide pediatric residents with simulated experiences in recognizing, diagnosing, and managing acute pediatric conditions.
Main Methods:
- Twenty simulated pediatric crisis scenarios were created.
- Twenty-nine residents participated, completing 10 scenarios each, scored by two raters.
- Psychometric analyses were performed on action-item checklist and global scores.
Main Results:
- Resident scores demonstrated high reliability (>0.79) using both scoring methods.
- Scenario and scenario-resident interaction were the primary sources of score variance.
- Interrater reliability was high, with low rater variance; more experienced residents scored higher than interns.
Conclusions:
- A reliable inventory of critical events was developed to assess pediatric residents' skills.
- Multiple scenarios provide a reliable measure of ability, with scores supporting construct validity.
- Further research is needed to confirm if this simulation improves real-life critical event management.
