Related Experiment Video
Updated: Jun 11, 2025
05:25
Setup and Execution Of the Blindfolded Code Training Exercise
Published on: March 29, 2019
9.4K
Assessing Team Performance in a Longitudinal Neonatal Resuscitation Simulation Training Program: Comparing Validity
Sierra Soghikian1, Micheline Chipman2, Jeffrey Holmes3
1Maine Track Program, Tufts University School of Medicine, Boston, USA.
Cureus
|October 7, 2024
Summary
Selecting the best teamwork assessment tool for neonatal resuscitation simulation is crucial. The Mayo High Performance Teamwork Scale showed moderate reliability and ease of use, despite other tools offering more comprehensive assessments.
Area of Science:
- Medical Simulation
- Teamwork Assessment
- Neonatal Resuscitation
Background:
- Neonatal resuscitation is a critical, infrequent event requiring proficient interprofessional teams.
- Simulation-based training is ideal for practicing and evaluating team performance in high-acuity, low-occurrence events.
- Existing teamwork assessment tools require evaluation for validity in specific training contexts.
Purpose of the Study:
- To select the most valid teamwork assessment tool for a longitudinal in situ simulation training program for delivery room teams.
- To evaluate four potential teamwork assessment tools (Mayo, TPOT, CTS, TEAM) using Messick's framework for validity evidence.
Main Methods:
- A framework by Messick was used to assess validity evidence of four teamwork assessment tools.
- Three simulation experts reviewed and scored 10 neonatal resuscitation simulations using each tool.
- Tools were rated on efficiency, ease of interpretation, and completeness; interrater reliability (IRR) and correlation with adherence scores were calculated.
Main Results:
- The Mayo High Performance Teamwork Scale demonstrated the highest interrater reliability (IRR) (single 0.55, multi 0.78) and was ranked highest for efficiency and ease of use.
- The Team Performance Observation Tool (TPOT) and Clinical Teamwork Scale (CTS) scored highest for completeness of teamwork assessment.
- No significant correlation was found between any teamwork tool scores and Neonatal Resuscitation Program (NRP) adherence scores.
Conclusions:
- The Mayo scale is a suitable tool for this program due to its moderate IRR and superior ease of use and efficiency.
- Poor IRR for other tools is a common challenge in teamwork assessment, potentially influenced by performance distribution and clinical context.
- Assessment tool validity is contextual, requiring careful consideration of the specific training environment and objectives.
