A reliable and valid method for evaluating cardiopulmonary resuscitation training outcomes

Area of Science:

• Medical Education
• Emergency Medicine
• Cardiopulmonary Resuscitation

Background:

• Effective cardiopulmonary resuscitation (CPR) training requires reliable and valid outcome assessments.
• Conventional CPR skill sheets lack proven reliability and validity for assessing compressions and ventilations.
• Few studies detail CPR assessment procedures or their reliability and validity.

Purpose of the Study:

• To evaluate the reliability and validity of a simplified CPR checklist for assessing CPR performance.
• To establish a standardized method for meaningful CPR training outcome assessment.
• To enable comparability of CPR training outcomes across different studies.

Main Methods:

• Utilized a 14-item simplified CPR checklist with an instrumented manikin.
• Trained evaluators assessed 171 CPR trainees.
• Assessed inter-rater agreement using Pearson correlation and checklist reliability using Cronbach's alpha.
• Evaluated criterion-related validity by correlating checklist scores with subjective overall CPR ratings (Spearman correlation).

Main Results:

• High inter-rater agreement was observed (Pearson correlation = 0.87).
• The simplified CPR checklist demonstrated high reliability (Cronbach's alpha = 0.89).
• Strong criterion-related validity was found, correlating well with subjective ratings (Spearman correlation = 0.92).

Conclusions:

• A simplified CPR checklist, combined with an instrumented manikin, provides a reliable and valid method for CPR skill assessment.
• Standardized reporting of CPR training outcomes is crucial for inter-study comparability.
• This validated checklist can improve the quality of CPR performance assessment.