Mobile app validation: a digital health scorecard approach

Area of Science:

• Digital Health
• Health Informatics
• Mobile Health Applications

Background:

• The proliferation of digital health solutions, particularly mobile health (mHealth) applications, has outpaced the development of robust quality discernment methods.
• A lack of transparent and standardized validation frameworks hinders stakeholders' ability to assess the quality of mHealth apps.
• Low development barriers and direct-to-consumer marketing contribute to a crowded and challenging mHealth landscape.

Purpose of the Study:

• To pragmatically apply the Digital Health Scorecard framework for evaluating the quality of popular mobile health oncology applications.
• To identify specific areas of strength and weakness in mHealth oncology apps based on a standardized validation approach.

Main Methods:

• A cohort of 22 popular mobile health oncology applications was evaluated using the Digital Health Scorecard framework.
• Performance was assessed across multiple domains including cost, usability, technical aspects, clinical value, and end-user requirement satisfaction.

Main Results:

• The evaluated mHealth oncology apps collectively scored 49.4% across all criteria.
• Performance varied significantly by domain: cost (100%), usability (56.7%), technical limitations (37.3%), clinical value (15.9%), and end-user satisfaction (37.2%).
• Apps demonstrated significant technical limitations, limited clinical utility, and a failure to meet prospectively defined end-user needs.

Conclusions:

• The study underscores the critical need for transparent and standardized evaluation methods for digital health tools.
• Existing mHealth oncology apps exhibit substantial deficits in clinical value and user satisfaction, necessitating improved validation processes.
• Implementing standardized frameworks like the Digital Health Scorecard can guide healthcare stakeholders in selecting higher-quality digital health solutions.