Alternatives to switch-cost scoring in the task-switching paradigm: their reliability and increased validity

Area of Science:

• Cognitive psychology
• Neuroscience

Background:

• The traditional latency switch-cost score in task-switching paradigms measures reaction time differences but ignores accuracy.
• Task-switching ability, a key executive function, may involve costs in both speed and accuracy.

Purpose of the Study:

• To evaluate traditional and alternative scoring methods for measuring task-switching ability.
• To determine which scoring methods best account for both latency and accuracy costs.

Main Methods:

• Two experiments were conducted with varying response deadlines (unlimited vs. limited time).
• Evaluated traditional (latency, accuracy switch-cost) and alternative (rate residual, bin score, inverse efficiency) scoring methods.
• Assessed reliability, accuracy cost accounting, and validity against an independent executive function task (antisaccade analogue).

Main Results:

• Alternative methods (rate residual, bin score, inverse efficiency) showed comparable reliability to latency scores without deadlines.
• Alternative methods were more reliable than latency scores under limited time conditions with higher error rates.
• Rate residual and bin score methods demonstrated superior validity, correlating better with executive functioning and detecting larger effects.

Conclusions:

• Alternative scoring methods (rate residual, bin score, inverse efficiency) offer a more comprehensive measure of task-switching ability by integrating latency and accuracy.
• The rate residual and bin score methods are particularly recommended for their superior reliability and validity.
• These improved measures can enhance the study of executive functions and cognitive control.