A validity scale for the Sharp consumer satisfaction scales.

Area of Science:

• Psychological assessment
• Mental health services research
• Survey methodology

Background:

• Consumer satisfaction surveys in mental health services often report inflated scores.
• This inflation can hinder accurate assessment of service quality and client experiences.
• A reliable method is needed to validate self-reported satisfaction data.

Purpose of the Study:

• To develop and validate a brief scale to identify potentially inflated satisfaction scores.
• To improve the accuracy of measuring true client satisfaction with mental health services.
• To enhance the predictive validity of satisfaction questionnaires.

Main Methods:

• Development of a 5-item validity scale for the SHARP questionnaire.
• Statistical analysis including discrimination tests and stepwise regression.
• Application and derivation of validity weights across multiple experimental samples (N=38, 49, 26, 121).

Main Results:

• The validity scale significantly discriminated between clients offering service improvement suggestions and those who did not (p < .001).
• The scale improved the prediction of true client satisfaction scores from obtained scores (p < .01).
• Application of derived weights significantly reduced deviation between obtained and true scores across multiple samples (p < .05).

Conclusions:

• The 5-item validity scale effectively addresses inflated consumer satisfaction scores in mental health.
• This tool enhances the accuracy and reliability of mental health service evaluation.
• The validated scale offers a robust method for assessing genuine client experiences.