Short Report: Comparison of three methods for identifying implementation determinants to measurement-based care

Area of Science:

• Implementation Science
• Health Services Research
• Qualitative Research Methods

Background:

• Identifying implementation determinants (barriers and facilitators) is crucial in implementation science.
• Few studies evaluate how different methods for identifying determinants complement or diverge.
• This study compares three methods within a youth healthcare implementation project.

Purpose of the Study:

• To compare the convergence and divergence of determinants identified by three distinct methods.
• To evaluate the unique contributions of each method in identifying implementation barriers and facilitators.
• To inform the selection of appropriate methods for determinant assessment in future research.

Main Methods:

• Employed rapid evidence synthesis, rapid ethnographic assessment, and design probes to identify implementation determinants.
• Compared the convergence of identified determinants using Jaccard plots and pairwise Jaccard indices.
• Utilized data from the Novel Methods for Implementing Measurement-Based Care with Youth in Low-Resource Environments study.

Main Results:

• All three methods identified a total of 42 determinants; 14 (33%) were common to all methods.
• Rapid ethnographic assessment yielded the highest number of determinants (83%), including unique findings.
• Rapid evidence synthesis identified unique determinants from literature/theory; design probes highlighted participant perspectives without unique contributions.

Conclusions:

• Substantial overlap exists between the three methods, confirming their complementary nature.
• Each method offers unique insights, with rapid ethnographic assessment having the highest yield.
• Researchers should weigh the tradeoffs and select methods based on specific study needs for comprehensive determinant assessment.