Related Experiment Video
Updated: Feb 15, 2026
A Novel Approach for the Administration of Medications and Fluids in Emergency Scenarios and Settings
Published on: November 9, 2016
Validity Evidence for a Serious Game to Assess Performance on Critical Pediatric Emergency Medicine Scenarios
James M Gerard1, Anthony J Scalzo, Matthew A Borgman
1From the Saint Louis University School of Medicine (J.M.G., A.J.S., S.N., R.K.C.), St. Louis, MO; Brooke Army Medical Center (M.A.B.), Fort Sam Houston, TX; Uniformed Services University of the Health Sciences (M.A.B., B.L.F.), Bethesda, MD; Medical College of Georgia (C.M.W.), Augusta University, Augusta, GA; Naval Medical Center San Diego (C.E.B.), San Diego, CA; Uniformed Services University of the Health Sciences (C.E.B.), Bethesda, MD; Keck School of Medicine of University of Southern California (T.P.C.), Los Angeles, CA; Yale University School of Medicine (M.A.), New Haven, CT; Columbia University College of Physicians and Surgeons (D.O.K.), New York, NY; Naval Medical Center Portsmouth (B.L.F.), Portsmouth, VA; Texas Tech University Health Sciences Center (B.S.P.), Lubbock, TX; Department of Psychiatry (S.N.), Saint Louis University School of Medicine, St. Louis, MO; and Val G. Hemming Simulation Center (J.O.L.), Uniformed Services University of the Health Sciences, Bethesda, MD.
Introduction:
We developed a first-person serious game, PediatricSim, to teach and assess performances on seven critical pediatric scenarios (anaphylaxis, bronchiolitis, diabetic ketoacidosis, respiratory failure, seizure, septic shock, and supraventricular tachycardia). In the game, players are placed in the role of a code leader and direct patient management by selecting from various assessment and treatment options. The objective of this study was to obtain supportive validity evidence for the PediatricSim game scores.
Methods:
Game content was developed by 11 subject matter experts and followed the American Heart Association's 2011 Pediatric Advanced Life Support Provider Manual and other authoritative references. Sixty subjects with three different levels of experience were enrolled to play the game. Before game play, subjects completed a 40-item written pretest of knowledge. Game scores were compared between subject groups using scoring rubrics developed for the scenarios. Validity evidence was established and interpreted according to Messick's framework.
Results:
Content validity was supported by a game development process that involved expert experience, focused literature review, and pilot testing. Subjects rated the game favorably for engagement, realism, and educational value. Interrater agreement on game scoring was excellent (intraclass correlation coefficient = 0.91, 95% confidence interval = 0.89-0.9). Game scores were higher for attendings followed by residents then medical students (Pc < 0.01) with large effect sizes (1.6-4.4) for each comparison. There was a very strong, positive correlation between game and written test scores (r = 0.84, P < 0.01).
Conclusions:
These findings contribute validity evidence for PediatricSim game scores to assess knowledge of pediatric emergency medicine resuscitation.
More Related Videos
Related Concept Videos
02:55The Evidence for Evolution
01:29Reliability and Validity
01:27Emerging Adulthood
01:26Pharmaceutical Poisoning: Potential Scenarios
01:16Critical Region, Critical Values and Significance Level
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the...
01:31Critical Values