Measuring mentalizing: A comparison of scoring methods for the hinting task.

Area of Science:

• Psychiatry
• Neuroscience
• Psychometrics

Background:

• The Hinting task is a useful measure for social cognition in clinical trials.
• The Social Cognition Psychometric Evaluation (SCOPE) study validated its use with a stringent scoring system.
• The necessity of the SCOPE scoring system for the task's psychometric soundness is unclear.

Purpose of the Study:

• To compare the psychometric properties of the Hinting task using its original scoring criteria versus the SCOPE criteria.
• To evaluate the impact of scoring criteria on the task's utility in clinical populations.

Main Methods:

• Independent raters rescored SCOPE data using original and SCOPE criteria.
• Psychometric properties were compared across samples of individuals with chronic schizophrenia, early psychosis, and their matched controls.
• Sample sizes: Chronic (n=397 schizophrenia, n=300 controls), Early Psychosis (n=38, n=39 controls).

Main Results:

• SCOPE criteria lowered average scores and reduced ceiling effects in both samples.
• Revised scoring strengthened correlations with outcome measures in the chronic sample.
• Revised scoring improved differentiation between early psychosis patients and controls.
• Test-retest reliability and internal consistency did not improve and remained suboptimal, especially for controls.

Conclusions:

• The SCOPE scoring criteria enhance certain psychometric properties and clinical utility of the Hinting task.
• Implementation of SCOPE scoring criteria is recommended for improved measurement in clinical trials.
• Further refinement may be needed to address suboptimal reliability and consistency, particularly in control groups.