Evaluating Digital Health Interventions: Key Questions and Approaches

Area of Science:

• Digital Health
• Health Services Research
• Intervention Science

Background:

• Digital health interventions (DHIs) promise to enhance healthcare effectiveness, efficiency, accessibility, safety, and personalization.
• Developing and deploying DHIs requires a robust, cumulative knowledge base derived from rigorous evaluation.
• Evaluating DHIs presents unique challenges due to their interdisciplinary nature, spanning biomedical, behavioral, computing, and engineering fields.

Discussion:

• Appraising DHIs necessitates a comprehensive evaluation strategy addressing specific research questions.
• Key questions involve defining the problem, potential benefits, reach, uptake, causal models, intervention components, and interactions.
• Estimating overall benefits requires assessing effectiveness, cost-effectiveness, and potential harms.

Key Insights:

• Randomized controlled trials (RCTs) are crucial for evaluating DHI effectiveness and cost-effectiveness.
• RCTs should be conducted when DHIs and delivery packages are stable, implementable with high fidelity, and likely to yield clinically meaningful benefits.
• A broader portfolio of research questions and evaluation methods is essential for informing DHI policy, practice, and future research.

Outlook:

• Developing standardized evaluation frameworks for DHIs is critical for advancing the field.
• Interdisciplinary collaboration is key to addressing the complexities of DHI research and implementation.
• Future research should focus on refining methodologies for assessing the real-world impact and scalability of DHIs.