The practice of 'doing' evaluation: lessons learned from nine complex intervention trials in action

Area of Science:

• Health Services Research
• Clinical Trial Methodology
• Intervention Science

Background:

• Complex health interventions face challenges in real-world settings.
• Process evaluations address intervention implementation deviations but not evaluation activity deviations.
• A systematic approach is needed to account for how evaluation activities impact data interpretation.

Purpose of the Study:

• To explore experiences of conducting evaluations in real-life complex intervention trials.
• To identify lessons learned for managing evaluation activities in varied health service settings.
• To propose reflexivity as a standard practice for improving evaluation interpretation.

Main Methods:

• Collective case study of nine complex intervention trials.
• Data collection through in-depth interviews, participant-observation, and discussion rounds.
• Focus on trials improving malaria diagnosis and treatment in diverse health settings.

Main Results:

• Identified six key lessons for managing trial fabric (researchers, fieldworkers, participants, data tools).
• Emphasized fostering shared understanding, intra-team communication, and collaboration.
• Highlighted the role of a field research coordinator and reflective field notes.

Conclusions:

• Reflexivity is essential for meaningful interpretation of complex intervention effects.
• Standardizing reflexivity in evaluations will better inform future implementation and decision-making.
• Addressing the interface of evaluation and intervention is critical for robust findings.