Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions

Area of Science:

• Digital Health
• Psychometrics
• Health Services Research

Background:

• User satisfaction is crucial for evaluating web-based health interventions.
• Assessing user satisfaction can strengthen evidence for intervention effectiveness.
• Validated measures are needed to assess satisfaction with digital health interventions.

Purpose of the Study:

• To analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I).

Main Methods:

• The psychometric quality of the CSQ-I was assessed using data from two randomized controlled trials.
• Multigroup confirmatory factor analyses were used to test factorial structure and measurement invariance.
• Construct validity was examined by correlating satisfaction scores with clinical outcomes.

Main Results:

• The CSQ-I demonstrated a robust one-factorial structure with good fit indices and partial strong invariance across samples.
• The scale exhibited excellent reliability (McDonald's omega .95 and .93).
• Significant correlations with changes in depressive symptoms and perceived stress confirmed construct validity.

Conclusions:

• The CSQ-I possesses strong psychometric properties, including internal consistency, factorial structure, and construct validity.
• Its robustness across different samples makes it suitable for evaluating user satisfaction in web-based interventions.
• The CSQ-I is a valuable tool for incorporating user perspectives into the evaluation of digital mental health interventions.