Related Experiment Video
Updated: Jul 19, 2026
Assessment and Evaluation of the High Risk Neonate: The NICU Network Neurobehavioral Scale
Published on: August 25, 2014
Assessment of neonatal resuscitation skills: a reliable and valid scoring system
Philine A van der Heide1, Letty van Toledo-Eppinga, Maaike van der Heide
1Department of Neonatology, Emma Children's Hospital, Academic Medical Centre, University of Amsterdam, Amsterdam, The Netherlands.
Objective:
To study the reliability and validity of a scoring instrument for the assessment of neonatal resuscitation skills in a training setting.
Methods:
Fourteen paediatric residents performed a neonatal resuscitation on a manikin, while being recorded with a video camera. The videotapes were analysed using an existing scoring instrument with an established face and content validity, adjusted for use in a training setting. Intra- and inter-rater reliability were assessed by comparing the ratings of the videotapes of three raters, one of who rated the videotapes twice. Intra-class coefficients (ICC) were calculated for the sum score, percentages of agreement and kappa coefficients for the individual items. To study construct validity, the performance of a second resuscitation of by residents was assessed after they had received feedback on their first performance.
Results:
The ICC were 0.95 and 0.77 for intra- and inter-rater reliability, respectively. The median percentage of intra-rater agreement was 100%; inter-rater agreement 78.6-84.0%. The median kappa was 0.85 for intra-rater reliability, and 0.42-0.59 for inter-rater reliability. Residents showed a 10% improvement (95% confidence interval -4; 23%) on performance of a second resuscitation, which supports the instrument's construct validity.
Conclusion:
A useful and valid instrument with good intra-rater and reasonable inter-rater reliability is now available for the assessment of neonatal resuscitation skills in a training setting. Its reliability can be improved by using a more advanced manikin and by training of the raters.
Related Concept Videos
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
01:19Respiratory Assessment: Purpose and Indications
Objectives and Importance:
The primary goal of respiratory assessment is to evaluate patients at early risk of clinical deterioration. Since respiratory distress often precedes other signs of declining health, breathing patterns and sounds become a...
01:20Assessment of Ventilation I: Respiratory Rate
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
01:23Assessment of Respiration
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like asthma or COPD,...
01:21Cardiopulmonary Resuscitation I: Adult