Challenges in evaluating implementation and effectiveness in real-world settings: evaluation proposal for...

Area of Science:

• Public Health
• Health Services Research
• Implementation Science

Background:

• Evaluating health-promoting activities in complex systems requires integrating implementation and effectiveness data.
• Existing guidelines lack specific methods for analyzing combined data from real-world intervention evaluations.
• Primary school-based health promotion initiatives present a complex system for evaluation.

Purpose of the Study:

• To present a novel data categorization approach for evaluating health-promoting activities in complex systems.
• To link the degree of intervention implementation with observed effectiveness outcomes.
• To provide a framework for analyzing combined effectiveness and implementation data.

Main Methods:

• Developed a data categorization approach inspired by Rogers' Diffusion of Innovations theory.
• Applied the approach to evaluate primary school-based health-promoting activities.
• Focused on relating implementation data to effectiveness outcomes in a real-world context.

Main Results:

• The proposed approach facilitates structuring results by categorizing data based on implementation levels.
• It enables relating the degree of implementation to observed effectiveness outcomes.
• The method aids in understanding intervention effectiveness under varying real-world circumstances.

Conclusions:

• The data categorization approach offers insights into intervention effectiveness in complex settings.
• It can guide stakeholders in optimizing population-based health interventions for maximum impact.
• Further testing and adaptation are needed, and knowledge sharing is encouraged.