Comparing scoring algorithms for NIH Toolbox executive function tasks in children with and without ADHD

Area of Science:

• Neuroscience
• Developmental Psychology
• Cognitive Psychology

Background:

• Executive function (EF) is crucial for goal-directed behavior.
• Understanding how different scoring algorithms affect EF measurement in pediatric Attention-Deficit/Hyperactivity Disorder (ADHD) is unclear.
• Existing research often relies on single metrics, potentially overlooking nuances in ADHD-related cognitive deficits.

Purpose of the Study:

• To compare the reliability and clinical sensitivity of four scoring algorithms (Accuracy, Speed, Rate Corrected Score (RCS), and Linear Integrated Speed-Accuracy Score (LISAS)) for measuring executive function in children with ADHD.
• To investigate how these algorithms influence the detection of group differences in cognitive flexibility and inhibitory control.
• To determine the most effective scoring method for identifying executive function impairments in pediatric ADHD.

Main Methods:

• Utilized the NIH Toolbox Dimensional Change Card Sort (DCCS) and Flanker Inhibitory Control and Attention (Flanker) tests.
• Compared four scoring algorithms: Accuracy, Speed, Rate Corrected Score (RCS), and Linear Integrated Speed-Accuracy Score (LISAS).
• Analyzed data from 51 children with ADHD and 102 matched controls, assessing internal consistency and group differences.

Main Results:

• The Rate Corrected Score (RCS) and Speed algorithms demonstrated high internal consistency.
• Accuracy and Linear Integrated Speed-Accuracy Score (LISAS) indices showed lower reliability, especially for cognitive flexibility in the ADHD group.
• Children with ADHD exhibited lower accuracy and higher switching costs on the DCCS, deficits detected by accuracy-based metrics but obscured by speed-only scores.

Conclusions:

• Accuracy-dominant metrics, particularly RCS, offer reliable and clinically sensitive alternatives to single-metric scores for assessing executive function in ADHD.
• Relying solely on response speed may underestimate cognitive flexibility deficits in children with ADHD.
• The choice of scoring algorithm is critical for accurately measuring executive function and identifying specific cognitive impairments in pediatric ADHD.