MCMI-III diagnostic validity: bad test or bad validity study

P Retzlaff1

  • 1Department of Psychology, University of Northern Colorado, Greeley 80639, USA.

Insights

The Millon Clinical Multiaxial Inventory-III (MCMI-III) shows poor predictive accuracy for diagnoses. A new validity study is essential to confirm its clinical utility and diagnostic performance.

Area of Science:

  • Psychological assessment
  • Clinical psychology
  • Psychometrics

Background:

  • Operating characteristics are crucial for evaluating diagnostic test validity.
  • Key validity statistics for the Millon Clinical Multiaxial Inventory-III (MCMI-III) are not fully published.
  • Previous versions, like the MCMI-II, provide a comparative baseline.

Purpose of the Study:

  • To calculate and assess the operating characteristics, specifically positive predictive power, of the MCMI-III scales.
  • To compare the MCMI-III's predictive validity against the MCMI-II.
  • To identify limitations in the initial MCMI-III validity study.

Main Methods:

  • Calculation of positive predictive powers from available MCMI-III statistics.
  • Comparison of calculated MCMI-III statistics with published MCMI-II data.
  • Critical review of the methodology and execution of the MCMI-III validity study.

Main Results:

  • The positive predictive powers of the MCMI-III scales are inadequate in absolute terms.
  • MCMI-III's predictive validity is poor relative to the MCMI-II.
  • The initial MCMI-III validity study had inherent and execution-related flaws.

Conclusions:

  • The MCMI-III demonstrates poor diagnostic predictive power based on available data.
  • Concerns exist regarding the methodology of the MCMI-III's initial validity assessment.
  • A new, rigorous validity study is required to ascertain the MCMI-III's true clinical utility.

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
McNemar's Test01:23

McNemar's Test

McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...