Metrics to evaluate implementation scientists in the USA: what matters most?

Area of Science:

• Implementation Science
• Public Health Research

Background:

• Implementation science is a rapidly growing field.
• The unique, applied nature of implementation science necessitates an examination of its scholarly activities within academic evaluation processes.

Purpose of the Study:

• To understand how implementation scientists perceive the factors influencing tenure and promotion.
• To identify the criteria for success in implementation science and how impact is defined.
• To determine the top journals in implementation science and their perceived prestige.

Main Methods:

• A survey was administered to implementation scientists, primarily in the USA.
• Quantitative data were analyzed using descriptive statistics and Wilcoxon signed-rank tests.
• Qualitative responses were analyzed using content analysis.

Main Results:

• Four key factors for tenure and promotion: publication quantity/quality, funding, and teaching excellence.
• Six key factors for success: presentations, service, community/research impact, partnerships, and dissemination to non-research audiences.
• Impact was most often defined as changes in practice or policy; "Implementation Science" was identified as the top journal.

Conclusions:

• A significant disconnect exists between factors valued for academic advancement (tenure/promotion) and those crucial for success in implementation science.
• These findings have implications for capacity building and highlight potential biases in current US-based promotion and tenure systems.