Related Experiment Video
Updated: Aug 14, 2026

Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 24, 2014
MCMI-III diagnostic validity: bad test or bad validity study
1Department of Psychology, University of Northern Colorado, Greeley 80639, USA.
Abstract:
Operating characteristics describe the validity of tests that attempt to dichotomously predict a diagnosis. These statistics are not fully published in the Millon Clinical Multiaxial Inventory-III Manual (MCMI-III manual; Millon, 1994). When calculated from available statistics, the positive predictive powers of the MCMI-III scales are poor both in absolute terms and relative to the MCMI-II (Millon, 1987). There were a number of problems, however, with the initial MCMI-III validity study both inherently and in execution. Although it is doubtful that the MCMI-III is weaker than the MCMI-II, a new validity study is needed.
Insights
The Millon Clinical Multiaxial Inventory-III (MCMI-III) shows poor predictive accuracy for diagnoses. A new validity study is essential to confirm its clinical utility and diagnostic performance.
Area of Science:
- Psychological assessment
- Clinical psychology
- Psychometrics
Background:
- Operating characteristics are crucial for evaluating diagnostic test validity.
- Key validity statistics for the Millon Clinical Multiaxial Inventory-III (MCMI-III) are not fully published.
- Previous versions, like the MCMI-II, provide a comparative baseline.
Purpose of the Study:
- To calculate and assess the operating characteristics, specifically positive predictive power, of the MCMI-III scales.
- To compare the MCMI-III's predictive validity against the MCMI-II.
- To identify limitations in the initial MCMI-III validity study.
Main Methods:
- Calculation of positive predictive powers from available MCMI-III statistics.
- Comparison of calculated MCMI-III statistics with published MCMI-II data.
- Critical review of the methodology and execution of the MCMI-III validity study.
Main Results:
- The positive predictive powers of the MCMI-III scales are inadequate in absolute terms.
- MCMI-III's predictive validity is poor relative to the MCMI-II.
- The initial MCMI-III validity study had inherent and execution-related flaws.
Conclusions:
- The MCMI-III demonstrates poor diagnostic predictive power based on available data.
- Concerns exist regarding the methodology of the MCMI-III's initial validity assessment.
- A new, rigorous validity study is required to ascertain the MCMI-III's true clinical utility.
More Related Videos
Related Concept Videos
Reliability and Validity
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
McNemar's Test

