Related Experiment Video
Updated: Mar 17, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Meaningful use and good catches: More appropriate metrics for checklist effectiveness
Luke R Putnam1, Kathryn T Anderson1, Michael B Diffley1
1Center for Surgical Trials and Evidence-based Practice, Department of Pediatric Surgery at the University of Texas Health Science Center at Houston and Children's Memorial Hermann Hospital, Houston, TX.
Background:
The benefit of utilizing surgical safety checklists has been recently questioned. We evaluated our checklist performance after implementing a program that includes checklist-related good catches.
Methods:
Multifaceted interventions aimed at the preincision checklist and 5 prospective audits were conducted from 2011-2015. We documented adherence to the checklist (verbalization of each checkpoint), fidelity (meaningful performance of each checkpoint), and good catches (events with the potential to cause the patient harm but that were prevented from occurring). Good catches were divided into quality improvement-based categories (processes, medication, safety, communication, and equipment).
Results:
A total of 1,346 checklist performances were observed (range, 144-373/yr). Adherence to the preincision checklist improved from 30% to 95% (P < .001), while adherence to the preinduction and debriefing checklists decreased (71% to 56%, P = .002) and remained unchanged (76%), respectively. Preincision fidelity decreased from 86% to 76% (P = .012). Good catches were identified during 16% of preincision checklist performances; process issues were most common (32%) followed by issues of medication administration (30%) and safety (22%).
Conclusion:
Implementation of a systematic checklist program resulted in significant and sustainable improvement in performance. Meaningful use and associated good catches may be more appropriate metric than actual patient harm for measuring checklist effectiveness. Although not previously described, checklist-related good catches represent an unknown benefit of checklists.
More Related Videos
Related Concept Videos
Quality Assurance
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Quality Control
Quality control helps track data, visualize trends, and identify variations, making it easier to detect deviations that may affect the accuracy of an analysis. One way to do this is by generating a quality control chart, which...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Data Validation
Key parameters for method validation include:
Expected Frequencies in Goodness-of-Fit Tests

