Evaluating results of the implementation research MOOC using Kirkpatrick's four-level model: a cross-sectional...

Area of Science:

• Health Professions Education
• Implementation Science
• Global Health Training

Background:

• Implementation research (IR) training is scarce in low- and middle-income countries.
• A massive open online course (MOOC) was developed to address this training gap.
• The Kirkpatrick model is a standard framework for evaluating training programs.

Purpose of the Study:

• To evaluate the impact of an IR MOOC on participants' professional practice.
• To assess the effectiveness of the IR MOOC in enhancing skills and organizational outcomes.
• To identify facilitators and barriers to applying IR knowledge gained from the MOOC.

Main Methods:

• The study evaluated two IR MOOC offerings from 2018.
• Data were collected 1.5-2 years post-course via anonymous online surveys and interviews.
• A total of 748 participants responded to the survey, and seven were interviewed (all self-reported data).

Main Results:

• The IR MOOC positively impacted participants' professional practice and their organizations.
• Over 40% of participants modified or implemented changes in their work.
• Participants reported improved IR conduct, enhanced professional profiles, increased collaboration, research opportunities, and job promotion.

Conclusions:

• Participants perceived the IR MOOC as successful in achieving medium- and long-term professional and organizational outcomes.
• The MOOC enhanced participants' ability to conduct IR, leading to tangible benefits.
• Barriers such as lack of funding and organizational support were noted, impacting knowledge application.