Reliability, Validity, and User-Experience of Remote Unsupervised Computerized Neuropsychological Assessments in...

Area of Science:

• Neuroscience
• Gerontology
• Psychometrics

Background:

• Self-administered computerized neuropsychological assessments (CNAs) offer cost-effective and accessible alternatives to traditional in-person evaluations.
• However, there is limited data on the psychometric properties and user experience of CNAs in older adults within remote testing contexts.

Purpose of the Study:

• To evaluate the test-retest reliability of an unsupervised online neuropsychological test battery.
• To assess the convergent validity of the online battery against a gold-standard in-person neuropsychological assessment.
• To explore the user experience and acceptability of remote computerized testing among older adults.

Main Methods:

• Fifty-two older adults (mean age 65.8 years) completed online computerized tests (Cogstate Brief Battery and Cambridge Brain Sciences) on three occasions.
• Participants also underwent an in-person paper-and-pencil neuropsychological assessment.
• User experience was evaluated through questionnaires assessing test usability and overall satisfaction.

Main Results:

• Individual test-retest reliabilities varied (ICCs 0.20–0.83), but global cognition composites demonstrated excellent reliability (ICCs > 0.8).
• A strong convergent validity was found between the online measures and the in-person battery (canonical correlation R = 0.87).
• Most participants rated the online tests favorably regarding enjoyment and clarity of instructions, though 38% reported performance anxiety.

Conclusions:

• A combined brief online battery from two CNAs exhibits strong psychometric properties for remote assessment in older adults.
• The online battery demonstrates acceptable reliability and validity, comparable to traditional methods.
• The findings support the usability and acceptability of remote computerized neuropsychological testing for older populations.