Modeling Item Revisit Behavior: The Hierarchical Speed-Accuracy-Revisits Model

Area of Science:

• Educational Psychology
• Psychometrics
• Cognitive Science

Background:

• Most test takers utilize the entire allotted time for assessments, even after answering all questions.
• This behavior is often misattributed to speededness, but is instead linked to a tendency to revisit previously answered items.
• Understanding these test-taking behaviors is crucial for accurate assessment of student ability.

Purpose of the Study:

• To introduce a novel analytical approach for understanding student test-taking behaviors.
• To model response patterns, time allocation, and question revisiting simultaneously.
• To investigate the interplay between response speed, examinee ability, and the tendency to revisit questions.

Main Methods:

• Development of a new analytical framework integrating response data, response times, and revisit patterns.
• Empirical analysis of test-taker data using the proposed modeling approach.
• Examination of the relationships between speed, ability, and revisit tendency.

Main Results:

• Examinees' tendency to revisit questions is significantly correlated with their response speed.
• Distinct subgroups of examinees exhibit varied and identifiable test-taking behaviors.
• The proposed model provides a more nuanced understanding of how students allocate cognitive resources during assessments.

Conclusions:

• Student test-taking behavior, particularly item revisiting, is a complex phenomenon influenced by speed and ability.
• The new analytical approach offers valuable insights into the dynamics of assessment engagement.
• Future research can leverage this model to explore factors influencing revisit tendencies and optimize assessment design.