Psychometric Evaluation of the Modified Neonatal Resuscitation Program Adherence Assessment Tool When Utilized for In...

Area of Science:

• Medical Education
• Simulation Technology
• Neonatal Care

Background:

• Neonatal resuscitation is a critical, infrequent event requiring skilled teams.
• Simulation-based training, using Neonatal Resuscitation Program (NRP) guidelines, improves team competency.
• Evaluating performance during simulation is vital for effective feedback, but tools for telesimulation (TS) lack validation.

Purpose of the Study:

• To evaluate the psychometric properties of the modified NRP (mNRP) tool.
• To assess the reliability and validity of the mNRP tool in both onsite and TS environments.
• To provide evidence for using the mNRP tool in interprofessional team performance assessment.

Main Methods:

• Secondary analysis of 96 simulations using Classical Test Theory.
• Item analyses included difficulty, discrimination, and item-to-total correlation.
• Exploratory factor analysis (EFA) and interrater reliability (IRR) were conducted.

Main Results:

• Item analyses indicated a good range of difficulty and discriminative ability.
• EFA identified three components for onsite and four for TS.
• Cronbach's alpha was 0.76 (onsite) and 0.78 (TS), with significant differences between mNRP quartiles.
• IRR ranged from 0.5 to 0.9, showing moderate to good agreement.

Conclusions:

• The mNRP tool demonstrates reliability and validity for assessing team performance in both onsite and TS settings.
• Acceptable interrater reliability was found between novice and expert raters.
• The mNRP tool is suitable for evaluating interprofessional team performance in simulation-based training.