Frameworks for evaluating health research capacity strengthening: a qualitative study

Area of Science:

• Health Systems Research
• Evaluation Science
• Capacity Building

Background:

• Health research capacity strengthening (RCS) projects present evaluation challenges.
• Existing evaluation frameworks for RCS projects vary in development, purpose, and structure.
• The ESSENCE framework aims to harmonize funder evaluation requirements for RCS.

Purpose of the Study:

• To describe and compare key characteristics of health RCS evaluation frameworks.
• To explore the utilization of the ESSENCE framework for harmonizing evaluation requirements.

Main Methods:

• Analysis of health RCS evaluation frameworks from seven funding agencies (2004-2012).
• Employed a mixed-methods approach: document analysis, stakeholder survey, and consultations.
• Focused on framework development, purpose, users, structure, content, and evaluation issues.

Main Results:

• Frameworks primarily serve internal organizational performance needs of funders.
• Limited integration of theories specific to RCS and insufficient exploration of assumptions or context.
• The ESSENCE framework demonstrated limited usage.

Conclusions:

• Frameworks can be improved by including practical evaluation guidance and stakeholder involvement.
• Greater emphasis on framework rationales and separating generic from project-specific aspects is recommended.
• These improvements may enhance the harmonization of health RCS evaluations.