Factor validation and Rasch analysis of the individual recovery outcomes counter

Area of Science:

• Psychometric evaluation of mental health assessment tools.
• Application of Rasch measurement theory in clinical psychology.
• Statistical analysis of self-report measures in mental healthcare.

Background:

• The Individual Recovery Outcomes Counter (I.ROC) is a widely used 12-item self-assessment tool for adults with mental health issues in Scotland.
• Limited research has explored the psychometric properties of the I.ROC, raising questions about its continued suitability.
• This study addresses the need to validate the I.ROC's measurement properties for its current application.

Purpose of the Study:

• To rigorously test the measurement properties of the Individual Recovery Outcomes Counter (I.ROC).
• To ascertain the psychometric suitability of the I.ROC for its continued use in mental health services.
• To provide evidence-based recommendations for potential modifications to enhance the tool's utility.

Main Methods:

• Utilized anonymised data from 1743 adult mental health service users in Scotland.
• Applied Rasch measurement theory, principal components analysis, and confirmatory factor analysis.
• Investigated the impact of modifying the response structure from six-point to four-point scales.

Main Results:

• Rasch analysis indicated issues with the I.ROC's original six-point response structure.
• A revised four-point scale demonstrated well-ordered items measuring a single recovery construct with acceptable fit.
• Confirmatory factor analysis supported the revised structure, though items covered only 75% of the recovery continuum.

Conclusions:

• A modified I.ROC shows promise but requires further development for optimal use across all service users.
• Specific modifications to scoring, item content, and theoretical underpinnings are necessary.
• Enhancements are crucial for maximizing the I.ROC's utility for individuals and providing meaningful data for service providers.