Evaluating a quality improvement collaborative: a hybrid approach

Area of Science:

• Healthcare Management
• Quality Improvement Science
• Program Evaluation

Background:

• Quality Improvement Collaboratives (QICs) are widely adopted for enhancing healthcare services and patient outcomes.
• This study focuses on evaluating a specific QIC within a large, integrated healthcare organization in Wales, UK.

Purpose of the Study:

• To evaluate the effectiveness and impact of a Quality Improvement Collaborative (QIC) intervention.
• To assess participant satisfaction, learning, and the overall impact of the QIC.
• To develop and propose a hybrid evaluation framework for QICs.

Main Methods:

• A mixed-methods evaluation approach was employed, integrating documentary analysis, surveys, semi-structured interviews, and direct observation.
• The evaluation utilized two established frameworks: Kirkpatrick's model for participant-focused data and Stake's approach for intervention impact assessment.
• A novel hybrid framework combining these approaches was developed.

Main Results:

• The evaluation of the QIC intervention was predominantly positive, indicating it was largely fit-for-purpose.
• Specific areas for improvement within the QIC were identified.
• The hybrid framework provided a comprehensive interpretation of the QIC's success and impact.

Conclusions:

• The study highlights the value of a hybrid evaluation approach for complex healthcare quality improvement initiatives.
• A practical, hybrid framework is presented to guide the design and evaluation of future QICs.
• Further research is recommended to test this framework across diverse QIC designs and settings.