Related Experiment Video
Updated: Jan 20, 2026
Reliability and Validity: Consistency, Reproducibility and Accuracy
Validation of a digitally delivered visual paired comparison task: reliability and convergent validity with
Joshua L Gills1, Jordan M Glenn2, Erica N Madero3
1Exercise Science Research Center, University of Arkansas, Fayetteville, AR, USA.
Abstract:
Alzheimer's disease (AD) affects the memory and cognitive function of approximately 5.7 million Americans. Early detection subsequently allows for earlier treatment and improves outcomes. Currently, there exists a validated 30-min eye-tracking cognitive assessment (VPC-30) for predicting AD risk. However, a shorter assessment would improve user experience and improve scalability. Thus, the purposes were to (1) determine convergent validity between the 5-min web camera-based eye-tracking task (VPC-5) and VPC-30, (2) examine the relationship between VPC-5 and gold-standard cognitive tests, and (3) determine the reliability and stability of VPC-5. This prospective study included two healthy cohorts: older adults (65+ years, n = 20) and younger adults (18-46 years, n = 24). Participants were tested on two separate occasions. Visit 1 included the Montreal Cognitive Assessment (MoCA), Digit Symbol Coding test (DSC), NIH Toolbox Cognitive Battery (NIHTB-CB), VPC-30, and VPC-5. Visit 2 occurred at least 14 days later; participants completed the VPC-5, DSC, NIHTB-CB, and dual-task walking assessments (DT). VPC-30 significantly correlated with VPC-5 at the first (p < .001) and second (p = .001) time points. VPC-5 and DSC (p < .01) and Pattern Comparison Processing Speed Test (PSPAC) (p = .01) were also correlated on day 1. Significant associations existed between VPC-5 and DSC (p < .001), Flanker Inhibitory Control Test (p = .05), PSPAC (p < .001), and Picture Sequence Memory Test (p = .02) during day 14 testing session. The test retest reliability of VPC-5 was significant (p < .001). VPC-5 displayed moderate convergent validity with the VPC-30 and gold-standard measures of cognition, while demonstrating strong stability, suggesting it is a valuable assessment for monitoring memory function.
Related Concept Videos
Reliability and Validity
11:15Automated Visual Cognitive Tasks for Recording Neural Activity Using a Floor Projection Maze
10:36fMRI Validation of fNIRS Measurements During a Naturalistic Task
09:15The Attentional Set Shifting Task: A Measure of Cognitive Flexibility in Mice
05:33How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
10:07Using Fiberless, Wearable fNIRS to Monitor Brain Activity in Real-world Cognitive Tasks

