A closer look at the frame-of-reference effect in personality scale scores and validity

Area of Science:

• Psychological Measurement
• Personality Psychology

Background:

• Personality inventories are widely used for assessment.
• Generic personality inventories sometimes show moderate criterion-related validity.
• Frame-of-reference (FOR) use is hypothesized to improve validity.

Purpose of the Study:

• To investigate why frame-of-reference (FOR) use increases criterion-related validity of personality inventories.
• To test competing explanations for the effects of FOR on reliability and validity.

Main Methods:

• Conducted a between-subjects study (N = 337) and a within-subject study (N = 105).
• Examined the impact of FOR on response inconsistency and variability.
• Assessed the conceptual relevance of the FOR to the criterion.

Main Results:

• Frame-of-reference (FOR) use reduces within-person inconsistency in responding to generic items.
• FOR use increases validity by reducing between-person variability and within-person inconsistency.
• Conceptual relevance of the FOR to the criterion is crucial for enhanced validity.

Conclusions:

• Frame-of-reference (FOR) use enhances personality inventory validity through reduced response inconsistencies.
• The conceptual relevance of the FOR to the criterion is a key factor.
• Findings explain the moderate validities observed in generic personality inventories.