Related Experiment Video
Updated: Jul 19, 2025

06:49
Using Eye Movements to Evaluate the Cognitive Processes Involved in Text Comprehension
Published on: January 10, 2014
27.3K
Test-retest reliability of eye tracking measures in a computerized Trail Making Test
Lukas Recker1,2,3, Christian H Poth1,4,5
1Neuro-Cognitive Psychology and Center for Cognitive Interaction Technology, Bielefeld University, Bielefeld, Germany.
Journal of Vision
|August 18, 2023
Summary
This study assessed the reliability of eye-tracking measures in the Trail Making Test (TMT). While classic TMT completion times were reliable, eye-tracking scores varied, with some showing excellent reliability for cognitive processes and others poor reliability for eye-hand coordination.
Area of Science:
- Neuropsychology
- Cognitive Neuroscience
- Psychometrics
Background:
- The Trail Making Test (TMT) is widely used to assess executive functions and cognitive impairments.
- Traditional TMT measures lack specificity regarding underlying cognitive deficits.
- Eye tracking has been integrated with the TMT to provide more detailed insights into cognitive processes.
Purpose of the Study:
- To investigate the test-retest reliability of an eye-tracking version of the TMT.
- To determine the reliability of various eye-tracking-based scores for diagnostic applications.
Main Methods:
- Two healthy samples (n=31 and n=34) completed an eye-tracking TMT and a retest.
- Retest intervals were 3 days or 10-30 days.
- Reliability of classic completion times and eye-tracking metrics (e.g., fixation durations, number of fixations) was analyzed.
Main Results:
- Classic TMT completion times demonstrated good test-retest reliability.
- Eye-tracking scores showed variable reliability, ranging from excellent (fixation durations) to poor (fixations guiding manual responses).
Conclusions:
- Some eye-tracking TMT measures are reliable for assessing interindividual differences in information accumulation.
- Certain eye-tracking metrics are less suitable for diagnosing eye-hand coordination deficits.
- Further validation is needed for specific eye-tracking metrics in clinical diagnostics.

