How to Refine and Prioritize Key Performance Indicators for Digital Health Interventions: Tutorial on Using Consensus...

Area of Science:

• Digital Health
• Health Informatics
• Health Services Research

Background:

• Digital health interventions (DHIs) offer significant potential for healthcare improvement and promotion.
• A notable gap exists in established methodologies for developing, refining, and prioritizing Key Performance Indicators (KPIs) for DHI evaluation.
• The Gravitate Health project aims to address this by creating innovative digital health solutions.

Purpose of the Study:

• To present a structured, 4-stage process for developing, refining, and prioritizing KPIs for DHIs.
• To establish a framework for stakeholder consultation and consensus-building in KPI development for digital health projects.
• To create a robust set of KPIs for evaluating DHIs within the Gravitate Health project.

Main Methods:

• A 4-stage process involving stakeholder consultations, a scoping review, and the Delphi technique.
• Initial stakeholder consultations identified an extensive list of KPIs across 7 categories.
• The Delphi technique was employed for refining and prioritizing KPIs among 250 consortium members.

Main Results:

• The process resulted in the elimination of one category of KPIs, leaving six prioritized categories.
• The Delphi technique facilitated consensus on a substantial list of KPIs within a large, diverse consortium.
• The final list of KPIs is sensitive to diverse stakeholder needs and captures real-world data for DHI evaluation.

Conclusions:

• The presented 4-stage process, incorporating stakeholder consultation and the Delphi technique, provides a viable framework for KPI development in DHIs.
• This methodology ensures the creation of relevant and prioritized KPIs for effective DHI evaluation.
• The developed KPIs are crucial for capturing real-world data to assess the impact and success of digital health interventions.