Temporal stability and change in manifest intelligence scores: Four complementary analytic approaches

Area of Science:

• Psychological Measurement
• Educational Psychology
• Psychometrics

Background:

• Temporal stability of psychological test scores is essential for reliable and valid interpretations, particularly for intelligence tests.
• High-stakes educational decisions, such as special education placement, often rely on intelligence test scores, underscoring the need for temporal stability.
• Understanding the multifaceted nature of temporal stability, encompassing mean-level, individual-level, differential, and ipsative continuity, is critical.

Purpose of the Study:

• To present and adapt statistical methods for investigating the four distinct types of temporal stability in psychological research.
• To address specific challenges in intelligence research, such as controlling for general intelligence when analyzing lower-order cognitive abilities.
• To provide a comprehensive protocol for applying these methods to intelligence test data.

Main Methods:

• Development and adaptation of statistical techniques to assess mean-level change, individual-level change, differential continuity, and ipsative continuity.
• Application of these methods to a dataset of 114 gifted students.
• Utilizing a 6-month test-retest interval to evaluate temporal stability.

Main Results:

• The study successfully applied statistical methods to analyze different facets of temporal stability in intelligence test scores.
• The adapted methods allowed for nuanced investigations, including controlling for general intelligence effects.
• The analysis provided insights into the temporal stability of intelligence scores in a cohort of gifted students.

Conclusions:

• A comprehensive assessment of temporal stability requires investigating all four types: mean-level, individual-level, differential, and ipsative continuity.
• The presented statistical framework and adapted methods are suitable for rigorous intelligence research.
• The findings contribute to a better understanding of the reliability and consistency of intelligence test scores over time.