Expected Values for Category-To-Measure and Measure-To-Category Statistics: A Simulation Study

Area of Science:

• Psychometrics
• Statistical analysis
• Measurement theory

Background:

• Rating scales are evaluated using measure-to-category and category-to-measure statistics.
• A 40% cut-value is commonly suggested for these statistics.
• The empirical basis for the 40% cut-value is lacking in existing literature.

Purpose of the Study:

• To investigate the appropriateness of a static 40% cut-value for rating scale analyses.
• To examine expected values for measure-to-category and category-to-measure statistics across different contexts through simulation.

Main Methods:

• Conducted simulation studies to generate data under various conditions.
• Analyzed measure-to-category and category-to-measure statistics from simulated rating scales.
• Calculated expected values for these statistics in different simulated contexts.

Main Results:

• The study found that a static 40% cut-value is not consistently appropriate.
• Expected values for measure-to-category and category-to-measure statistics vary significantly depending on the context.
• Simulation results indicate a need for dynamic rather than static evaluation criteria.

Conclusions:

• The use of a fixed 40% cut-value for rating scale analysis is not recommended.
• Recommended to adopt expected values tailored to specific contexts for evaluating measure-to-category and category-to-measure statistics.
• This approach will lead to more accurate and reliable assessments of rating scale functioning.