Exploring the Influence of Item Characteristics in a Spatial Reasoning Task

Area of Science:

• Cognitive Psychology
• Educational Measurement
• Psychometrics

Background:

• Spatial reasoning is crucial for various academic and real-world tasks.
• Assessing spatial reasoning effectively requires understanding factors influencing item difficulty.
• Object assembly (OA) is a valuable format for spatial reasoning assessment.

Purpose of the Study:

• To investigate the sources of item difficulty in object assembly (OA) spatial reasoning assessments.
• To identify specific item characteristics that contribute to difficulty in OA tasks.
• To evaluate the utility of the linear logistic test model (LLTM) in spatial reasoning research.

Main Methods:

• Developed 15 new OA items with nine specified characteristics.
• Collected data from two samples: high-ability students (grades 3-7) and undergraduates.
• Applied the linear logistic test model (LLTM) to analyze item difficulty.

Main Results:

• Eight of the nine hypothesized item characteristics significantly predicted item difficulty.
• The LLTM effectively identified the impact of different spatial reasoning aspects on OA item difficulty.
• The findings provide empirical evidence for the contribution of specific features to spatial task complexity.

Conclusions:

• The LLTM is a valuable tool for dissecting item difficulty in spatial reasoning assessments.
• Understanding item characteristics can guide the development of more targeted and effective spatial assessments.
• This research contributes to the broader understanding of spatial cognition and its measurement.