How do we measure attention? Using factor analysis to establish construct validity of neuropsychological tests.

Area of Science:

• Cognitive Psychology
• Neuroscience
• Psychometrics

Background:

• Neuropsychological tests and experimental cognitive paradigms are used to assess cognitive functions, particularly attention.
• The construct validity of attention measures across these domains requires investigation.
• Previous work suggested a general attention factor in experimental paradigms.

Purpose of the Study:

• To determine if standardized neuropsychological tests and experimental cognitive paradigms measure the same cognitive faculties, specifically attention.
• To examine the factor structure of attention-related tasks from both experimental and neuropsychological domains.

Main Methods:

• A large online battery of six experimental cognitive tests and eight neuropsychological tests was administered to 636 participants.
• Exploratory factor analysis was used on a subset (n=357) to identify underlying cognitive factors.
• Confirmatory factor analysis was performed on the remaining participants (n=279) to validate the identified structure.

Main Results:

• A five-factor structure emerged: attentional capacity, search, Digit Span, Arithmetic, and sustained attention.
• Digit Span and Arithmetic were distinct from attention factors.
• Digit Symbol Coding and Spatial Span loaded onto attentional capacity.
• Trail Making Test (TMT-A, TMT-B) and Letter Cancellation loaded onto search (attention-shifting).

Conclusions:

• Standardized neuropsychological tests and experimental cognitive paradigms do not always measure the same cognitive constructs.
• Digit Span and Arithmetic should not be classified as attention tests.
• Specific neuropsychological tests like Digit Symbol Coding, Spatial Span, TMT-A, TMT-B, and Letter Cancellation can be classified as attention tests, measuring either attentional capacity or search ability.