Replicating a Meta-Analysis: The Search for the Optimal Word Choice Test Cutoff Continues

Area of Science:

• Psychology
• Neuropsychology
• Forensic Psychology

Background:

• Previous meta-analysis suggested a Word Choice Test (WCT) cutoff of ≤42 as optimal.
• The current study aimed to validate and refine WCT cutoffs using independent clinical samples.

Purpose of the Study:

• To evaluate the classification accuracy of various Word Choice Test (WCT) cutoffs.
• To compare WCT performance against psychometrically defined criterion groups.
• To investigate alternative detection methods like critical item and time-to-completion cutoffs.

Main Methods:

• Analysis of four independent clinical samples (N=252).
• Examination of WCT failure rates and classification accuracy across different cutoffs (≤47, ≤45, ≤42).
• Comparison with critical item and time-to-completion measures.

Main Results:

• WCT ≤45 demonstrated improved specificity (.91-.98) with acceptable sensitivity (.39-.50).
• A cutoff of ≤42 significantly reduced sensitivity (.30-.38) while misclassifying genuine deficits.
• Critical item and time-to-completion cutoffs showed effective detection capabilities.
• Scores between 43-47 provided comparable evidence of non-credible responding.

Conclusions:

• WCT ≤45 offers the best balance of sensitivity and specificity for detecting non-credible responding.
• A single optimal WCT cutoff may not be appropriate due to varying assessment environments.
• Further research is needed to understand the nuances of WCT cutoff accuracy in diverse settings.