What item response theory can tell us about the complex span tasks

Area of Science:

• Cognitive Psychology
• Psychometrics

Background:

• Working memory capacity is crucial for higher-order cognition and psychopathology.
• Complex span tasks are standard measures, but variations exist.
• Task administration time and set sizes impact measurement precision.

Purpose of the Study:

• To investigate the psychometric properties of operation span, symmetry span, and rotation span tasks.
• To evaluate the suitability of complex span tasks for different ability levels.
• To determine optimal task parameters for improved discriminability and predictive validity.

Main Methods:

• Utilized item response theory and correlational analyses.
• Compared standard and expanded set size versions of complex span tasks.
• Analyzed data from two studies with varying sample sizes (n=573 and n=351).

Main Results:

• Standard operation span tasks show limitations for above-average ability samples.
• Increased set sizes enhance predictive validity and discriminability across all complex span tasks.
• Operation span tasks demonstrate lower predictive validity compared to spatial span tasks, even with larger set sizes.

Conclusions:

• The choice of complex span task and set size should be tailored to the target population's ability level.
• Avoid standard-length operation span tasks for average or higher ability groups.
• Expanded set sizes improve the psychometric properties of complex span tasks, particularly for spatial measures.