Replicating the classification accuracy of the Verbal Paired Associates and Visual Reproduction recognition trials as...

Area of Science:

• Neuropsychology
• Clinical Psychology
• Psychometrics

Background:

• The clinical utility of embedded performance validity tests (PVTs) is crucial for accurate neuropsychological assessment.
• The Wechsler Memory Scale-IV (WMS-IV) Verbal Paired Associates (VPA) and Visual Reproduction (VR) subtests have shown potential as embedded PVTs.
• Further validation and analysis are needed to confirm their efficacy and optimize their use.

Purpose of the Study:

• To replicate previous findings on the clinical utility of the WMS-IV VPA and VR subtests as embedded PVTs.
• To conduct a critical item (CR) analysis within the VPA recognition trial to enhance its performance validity detection.
• To evaluate the classification accuracy of these embedded PVTs in a mixed clinical sample.

Main Methods:

• Archival data from 119 adults in a mixed clinical sample were analyzed.
• Classification accuracy was computed by comparing subtest scores against criterion groups defined by established PVTs.
• A critical item analysis was performed on the VPA recognition trial.

Main Results:

• Age-corrected scaled scores ≤ 6 demonstrated high specificity but variable sensitivity for detecting noncredible responding.
• A VPA recognition cutoff of ≤ 34 and a VR recognition cutoff of ≤ 4 showed a favorable balance of sensitivity and specificity.
• Critical item analysis improved the sensitivity and specificity of the VPA recognition trial, and negative learning curves were highly specific to noncredible performance.

Conclusions:

• The findings largely support the use of WMS-IV VPA and VR subtests as embedded PVTs, consistent with prior research.
• Sample-specific variations in classification accuracy highlight the need for research on generalizability.
• Critical item analysis presents a cost-effective method to increase confidence in interpreting the VPA recognition trial as a PVT.