How to Develop a Qualitative Evaluation Plan for a Complex National Intervention: Key Steps and Reflections from the...

Area of Science:

• Public Health
• Health Services Research
• Program Evaluation

Background:

• The National Institute of Health (NIH) Rapid Acceleration of Diagnostics - Underserved Populations (RADx-UP) program supports over 137 projects nationwide.
• RADx-UP aims to improve access to timely and accurate COVID-19 diagnostics, prioritizing disproportionately affected populations.
• A comprehensive, mixed-methods evaluation strategy was essential for this large-scale initiative.

Purpose of the Study:

• To describe the development and implementation of a Qualitative Evaluation Plan (QEP) for the RADx-UP program.
• To understand the experiences of academic and community partners in implementing community-engaged research.
• To gain in-depth insights into how RADx-UP projects addressed COVID-19 outreach, testing, and response.

Main Methods:

• A three-phase approach was used to develop the QEP.
• Qualitative methods, including interviews, were employed to gather data.
• Processes included planning, sampling diverse projects, creating interview guides, data collection, analysis, and dissemination.

Main Results:

• The QEP development involved systematic planning, diverse project sampling, and structured data collection and analysis.
• Qualitative data provided in-depth understanding of partner experiences and project implementation strategies.
• Key takeaways and lessons learned were identified for future large-scale research evaluations.

Conclusions:

• A structured QEP is crucial for evaluating large, complex public health initiatives like RADx-UP.
• Understanding partner experiences and implementation nuances is vital for program success.
• The described QEP development process offers a valuable framework for other researchers.