A process for reviewing mental health apps: Using the One Mind PsyberGuide Credibility Rating System

Area of Science:

• Digital Health
• Mental Health Technology Assessment
• Psychometric Evaluation

Background:

• The proliferation of mental health apps necessitates reliable evaluation systems.
• Existing app rating systems have limitations in assessing credibility and quality.
• Independent advice is crucial for guiding the adoption of mental health applications.

Purpose of the Study:

• To refine the One Mind PsyberGuide Credibility Rating Scale (PGCRS) for evaluating mental health apps.
• To address limitations identified in the initial version of the PGCRS.
• To enhance the process of determining the quality of mental health apps.

Main Methods:

• The PGCRS underwent a revision process involving expert input, consumer research, and face validity testing.
• 161 mental health apps were re-evaluated using the updated PGCRS (Version 2).
• Reliability and score discrepancies were analyzed, and ratings were updated on the One Mind PsyberGuide.

Main Results:

• The updated PGCRS demonstrated varying item reliabilities, indicating areas of consistent and inconsistent rating.
• The average credibility score for 161 mental health apps was 2.51 out of 5.00.
• Credibility ratings showed weak correlation with app store star ratings, highlighting their unique value.

Conclusions:

• The refined PGCRS effectively summarizes app information across intervention specificity, consumer ratings, research, and development.
• An iterative rating and consensus review process ensures robust final scores.
• This updated scale and evaluation procedure offer a validated method for assessing mental health app quality.