Development of the Poor Validity Profile Analysis for the Medical Symptom Validity Test

Area of Science:

• Neuropsychology
• Cognitive Assessment
• Psychometrics

Background:

• The Medical Symptom Validity Test (MSVT) is used to assess performance validity.
• Current MSVT profile rules often misidentify individuals with suboptimal performance validity.
• There is a need for improved methods to accurately detect poor performance in cognitive assessments.

Purpose of the Study:

• To develop and validate a novel profile analysis for the MSVT.
• To enhance the accuracy of identifying suboptimal performance validity.
• To provide a more reliable tool for clinical and research settings.

Main Methods:

• A two-phase study was conducted.
• Phase I involved comparing graduate students simulating dementia with individuals diagnosed with dementia.
• A logistic equation with a logit model correction and four new profiles were developed and tested in Phase II with similar participant groups.

Main Results:

• The four proposed MSVT profiles demonstrated high specificity (94%-96%) and acceptable sensitivity (79.5%-95.5%) in Phase I.
• In Phase II, one profile showed superior performance with 95.7% specificity and 86% sensitivity.
• Aggregate analysis using the best profile yielded 96% specificity and 84% sensitivity.

Conclusions:

• A new, validated profile analysis for the MSVT has been developed.
• This alternative analysis demonstrates superior performance in identifying poor performance validity compared to existing methods.
• The findings suggest a more accurate approach to distinguishing genuine cognitive impairment from suboptimal effort.