Insights From the Health Profession Opportunity Grant Program's Three-Armed, Multi-Site Experiment for Policy...

Area of Science:

• Health Services Research
• Program Evaluation
• Workforce Development

Background:

• The Health Profession Opportunity Grants (HPOG) program, administered by the Administration for Children and Families (ACF), provided healthcare training to Temporary Assistance for Needy Families (TANF) recipients and low-income adults.
• HPOG aimed to improve employment and earning potential in high-demand healthcare occupations.

Purpose of the Study:

• To evaluate the impact of the HPOG program on participants' education, training, and employment in healthcare fields.
• To examine the contribution of specific program components (enhancements) to the overall program impact using a multi-armed experimental design.
• To share lessons learned from conducting a complex, multi-site evaluation for future research and program implementation.

Main Methods:

• A three-armed impact evaluation design was employed for the first cohort of HPOG grantees (HPOG 1.0).
• The evaluation leveraged the program's multi-site implementation, incorporating a second treatment arm in some locations.
• Qualitative and quantitative data were likely used to assess program implementation and outcomes.

Main Results:

• The evaluation provided insights into the effectiveness of different program components within a large-scale workforce development initiative.
• Findings informed the understanding of how specific enhancements influenced participant outcomes in healthcare training programs.
• The study highlighted the feasibility and challenges of implementing multi-armed experiments across multiple sites.

Conclusions:

• Multi-armed experiments can be valuable for dissecting program impacts in complex, multi-site settings.
• Understanding the contribution of individual program components is crucial for optimizing workforce development initiatives.
• Lessons learned from the HPOG 1.0 evaluation can inform the design and execution of future large-scale program evaluations and interventions.