How can we evaluate interference in attentional tests? A study based on bi-variate non-parametric tolerance limits

Area of Science:

• Cognitive Psychology
• Neuroscience
• Psychometrics

Background:

• Assessing cognitive interference in attentional tasks is crucial for understanding cognitive load.
• Current methods for quantifying interference, such as raw score differences, are susceptible to measurement artifacts.
• The selection of an appropriate interference quantification method remains a challenge.

Purpose of the Study:

• To compare different approaches for quantifying cognitive interference in attentional tasks.
• To evaluate the efficacy of univariate and bivariate methods using real-world data.
• To determine the most reliable method for assessing interference in tasks like Visual Reaction Times and the Stroop Test.

Main Methods:

• Utilized data from 209 healthy participants performing Visual Reaction Times (basic and go/no-go) and the Stroop Test.
• Compared univariate interference indices, including a complex score covaried for the basic score.
• Introduced and analyzed bivariate non-parametric tolerance limits for interference assessment.

Main Results:

• The complex score covaried for the basic score emerged as the most satisfactory univariate method for interference evaluation, though it requires data inspection.
• Bivariate non-parametric tolerance limits demonstrated advantages in terms of generalizability.
• The study highlights the limitations of simple difference scores in interference quantification.

Conclusions:

• The choice of interference quantification method impacts study outcomes and requires careful consideration.
• Covaried complex scores offer a robust univariate approach, while bivariate tolerance limits provide a more generalizable solution.
• Further research into standardized interference measurement is warranted for reliable cognitive assessments.