Investigating rating scale category utility.

Area of Science:

• Psychometrics
• Statistical analysis
• Measurement theory

Background:

• Rating scales are widely used in various fields, but ensuring their categories yield valid measurements is crucial.
• Assessing the quality of rating scales requires robust analytical methods to evaluate data coherence.

Purpose of the Study:

• To provide analysts with eight guidelines for investigating the cooperative functioning of rating scale categories.
• To offer a framework for evaluating the measurement quality of rating scales within the Rasch analysis context.

Main Methods:

• Guidelines focus on category frequency, ordering, and rating-to-measure inferential coherence.
• Evaluation from both measurement and statistical perspectives is emphasized.
• Application of guidelines to two published datasets illustrates their utility.

Main Results:

• The guidelines facilitate the identification of issues in rating scale category functioning.
• Analysis can lead to recategorization or reconceptualization of rating scales for improved measurement.
• Demonstrated practical application of the proposed guidelines on real-world data.

Conclusions:

• The suggested guidelines offer a systematic approach to evaluating rating scale data quality.
• Rasch analysis provides a valuable framework for assessing the psychometric properties of rating scales.
• These methods support the development of more reliable and valid measurement instruments.