Operationalizing community engagement evaluation: A structured and scalable approach using the RE-AIM framework and...

Area of Science:

• Translational Science
• Community Health
• Program Evaluation

Background:

• Community engagement (CE) is crucial in Clinical and Translational Science (CTS) but lacks standardized evaluation methods.
• The RE-AIM framework offers a structure for CE evaluation, yet its application in complex community settings is challenging due to data variability.
• Existing CE evaluation methods are often inconsistent, hindering effective program assessment and improvement.

Purpose of the Study:

• To develop and apply a structured, replicable seven-step approach for operationalizing the RE-AIM framework for community engagement program evaluation.
• To standardize the assessment of community engagement initiatives within Clinical and Translational Science.
• To enhance data-driven decision-making and program adaptation in community-based health programs.

Main Methods:

• Developed a seven-step approach to operationalize the RE-AIM framework, incorporating tailored subdomains and standardized scoring.
• Utilized visual analytics through Net Effects Diagrams for data interpretation and stakeholder collaboration.
• Applied the framework to evaluate community-based health education workshops in English and Spanish using surveys and facilitator feedback.

Main Results:

• The operationalized RE-AIM framework facilitated consistent assessment and comparison between English-language workshops (ELWs) and Spanish-language workshops.
• Spanish-language workshops demonstrated superior performance in attendance, participant satisfaction, and short-term effectiveness compared to ELWs.
• Net Effects Diagrams aided stakeholders in interpreting program outcomes and identifying actionable insights for program adaptation.

Conclusions:

• The developed approach provides a transparent, scalable, and context-sensitive method for assessing community engagement programs.
• This method supports continuous program improvement, data-driven decision-making, and enhanced stakeholder engagement.
• The approach is adaptable to various community and public health programs beyond CE initiatives.