Related Experiment Video
Updated: Jul 9, 2025

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
Published on: June 18, 2018
When Failing One Performance Validity Test Matters
1Mental Health Service, Ralph H. Johnson Veterans Affairs Healthcare System, Charleston, SC, USA.
Abstract:
There appears to be a lack of consensus regarding how best to interpret cognitive test findings when there is a failure on only one Performance Validity Test (PVT). The current study examined the impact of failing one freestanding, forced-choice, memory-based (Fr-FC-MB) PVT across two memory measures in a large sample of veterans (N = 1,353). The impact of failing zero, one, or two Fr-FC-MB PVTs (Test of Memory Malingering Trial 1 or the Medical Symptom Validity Test) on subsequent memory measures was examined (California Verbal Learning Test-II [CVLT-II], Brief Visuospatial Memory Test-R [BVMT-R]). Compared to those failing zero PVTs, those failing one PVT showed significant declines across all memory indices with large average effect sizes (BVMT-R, d = -0.9, CVLT-II, d = -1.0). Those failing one PVT had memory scores more similar to those failing two PVTs. There is a need for greater nuance and flexibility when determining invalid test performance. The current findings, along with a brief review of the literature, find that failing even one Fr-FC-MB PVT dramatically (negatively) impacts memory performance. Results suggest that including individuals failing one Fr-FC-MB PVT into a credible group should be more closely scrutinized.
Related Concept Videos
Reliability and Validity
Self-Presentation: Self-Monitoring and Self-Handicapping
Stereotype Threat and Self-fulfilling Prophecies
Errors In Hypothesis Tests
Significance Testing: Overview
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...

