Assessing response validity in college students' self-reported academic impairment

Area of Science:

• Neuropsychology
• Educational Psychology
• Psychometrics

Background:

• Accurate assessment of academic impairment is crucial for postsecondary students requiring accommodations.
• Existing self-report measures often lack validity indicators, making them vulnerable to noncredible responding.
• The Academic Impairment Measure (AIM) was developed as a norm-referenced instrument with an embedded validity scale.

Purpose of the Study:

• To evaluate the response validity scale of the AIM in differentiating genuine ADHD, controls, and simulators.
• To assess the AIM's ability to detect feigned ADHD and academic impairment in a postsecondary student population.

Main Methods:

• A simulation study was conducted with three groups: genuine ADHD (n=200), controls (n=258), and simulators (n=236).
• Participants completed the AIM, which includes a response validity scale designed to detect exaggeration.
• Statistical analyses, including Area Under the Curve (AUC), sensitivity, specificity, and predictive values, were used to evaluate the scale's performance.

Main Results:

• Simulators convincingly feigned ADHD and academic impairment, achieving significantly higher standard scores than controls.
• The AIM response validity scale demonstrated good differentiation between simulators and honest participants (AUC = .88) and between simulators and those with ADHD (AUC = .82).
• A specific cut score showed high specificity (0.91) and negative predictive power (0.91) for identifying noncredible responding.

Conclusions:

• The AIM serves as an efficient tool for assessing academic impairment and response validity in students with suspected disabilities.
• Neuropsychologists can utilize the AIM to support diagnosis, tailor accommodations, and monitor their effectiveness.
• The instrument is valuable for ensuring the integrity of assessment and accommodation processes in postsecondary education.