Selecting a rating scale for evaluating services to the chronically mentally ill.

Area of Science:

• Mental Health Services Research
• Psychometric Evaluation
• Program Evaluation

Background:

• Selecting appropriate outcome measures is crucial for evaluating mental health programs.
• Existing rating scales vary in their performance and suitability for specific populations.
• The National Institute of Mental Health (NIMH) established criteria for ideal outcome measures.

Purpose of the Study:

• To identify the best performing brief rating scales for monitoring treatment effectiveness.
• To compare seven rating scales using a multi-attribute utility analysis.
• To determine which scales align best with NIMH-defined criteria for outcome measures.

Main Methods:

• A multi-attribute utility analysis was conducted on seven brief rating scales.
• Judgmental data were collected from mental health therapists and evaluation experts.
• Performance data were transformed and weighted according to NIMH task force priorities.

Main Results:

• Two specific rating scales demonstrated superior performance across the evaluated criteria.
• These preferred scales effectively balanced various aspects of outcome measurement.
• The analysis provided a quantitative comparison of the seven instruments.

Conclusions:

• Two rating scales are recommended for monitoring the effectiveness of programs serving the chronically mentally ill.
• These scales offer a robust and reliable method for program evaluation in mental health.
• The findings support evidence-based practice in mental health service delivery.