Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Toward Precision Cardiac Rehabilitation: Current Limitations and Future Opportunities of Omics and Artificial Intelligence.

Sports medicine (Auckland, N.Z.)·2026
Same author

An Experimental Design to Investigate Item Parameter Drift.

Applied psychological measurement·2025
Same author

Proximity to Practice: The Role of Technology in the Next Era of Assessment.

Perspectives on medical education·2024
Same author

A Comparison of Remote vs In-Person Proctored In-Training Examination Administration for Internal Medicine.

Academic medicine : journal of the Association of American Medical Colleges·2024
Same author

A Clear Cell Sarcoma Case: A Diagnostic and Treatment Challenge, with a Promising Response to Trabectedin.

Case reports in oncology·2023
Same author

Examining ChatGPT Performance on USMLE Sample Items and Implications for Assessment.

Academic medicine : journal of the Association of American Medical Colleges·2023

Related Experiment Video

Updated: Sep 24, 2025

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.2K

Assessing the validity of test scores using response process data from an eye-tracking study: a new approach.

Victoria Yaneva1, Brian E Clauser2, Amy Morales2

  • 1National Board of Medical Examiners, 3750 Market Street, Philadelphia, PA, 19104-3102, USA. vyaneva@nbme.org.

Advances in Health Sciences Education : Theory and Practice
|May 5, 2022
PubMed
Summary

This study uses eye-tracking and machine learning to analyze how students answer multiple-choice questions (MCQs). Correct answers involve careful reading and stem-to-option processing, unlike incorrect ones.

Keywords:
Eye trackingMachine learningScore interpretationValidity

More Related Videos

Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension
06:49

Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension

Published on: January 10, 2014

27.4K
Eye Tracking During A Complex Aviation Task For Insights Into Information Processing
07:48

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing

Published on: April 4, 2025

612

Related Experiment Videos

Last Updated: Sep 24, 2025

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.2K
Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension
06:49

Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension

Published on: January 10, 2014

27.4K
Eye Tracking During A Complex Aviation Task For Insights Into Information Processing
07:48

Eye Tracking During A Complex Aviation Task For Insights Into Information Processing

Published on: April 4, 2025

612

Area of Science:

  • Educational Measurement
  • Cognitive Psychology
  • Data Science

Background:

  • Understanding test-taker response processes is crucial for validating score interpretations in multiple-choice questions (MCQs).
  • Eye-tracking technology offers a promising method for capturing detailed data on cognitive processes during test-taking.
  • Previous research has explored eye-tracking but lacked machine learning integration for score interpretation validity.

Purpose of the Study:

  • To introduce a novel methodology for evaluating score interpretation validity using eye-tracking data and machine learning.
  • To identify distinct eye-movement patterns associated with correct and incorrect responses in clinical MCQs.
  • To assess the contribution of various eye-tracking features to the classification of response accuracy.

Main Methods:

  • Collected eye-tracking data from 26 students answering clinical MCQs.
  • Engineered 119 eye-tracking features as input for a machine learning model.
  • Utilized machine learning to classify responses as correct or incorrect based on eye-movement patterns.
  • Evaluated feature combinations to understand their predictive power.

Main Results:

  • Eye-movement patterns differed significantly between correct and incorrect responses.
  • Incorrect responses were linked to processing from options to the question stem.
  • Correct responses were associated with stem-to-option processing, careful reading, and decisive option selection.
  • Machine learning models demonstrated the ability to predict response accuracy from eye-tracking data.

Conclusions:

  • The study validates a new data-driven approach to assessing score interpretation validity using eye-tracking and machine learning.
  • Observed eye-movement behaviors for correct responses align with established theoretical models of test-taking.
  • Identified response strategies associated with incorrect answers suggest potential areas for targeted remediation.
  • This research pioneers the use of machine learning with eye-tracking for evaluating the validity of MCQ score interpretations.