A new diagnostic accuracy measure and cut-point selection criterion
Tuochuan Dong1, Kristopher Attwood2, Alan Hutson1
11 Department of Biostatistics, University at Buffalo, Buffalo, NY, USA.
Statistical Methods in Medical Research
|October 22, 2015
Summary
This study introduces the maximum absolute determinant, a new diagnostic accuracy measure for diseases with multiple stages. It offers a superior method for selecting optimal cut-points compared to existing techniques.
Area of Science:
- Biostatistics
- Medical Diagnostics
- Machine Learning
Background:
- Existing diagnostic accuracy measures are limited to binary or three-stage diseases.
- Current methods for multi-stage diseases, like generalized Youden index, have limitations in cut-point selection and data utilization.
Purpose of the Study:
- To propose a novel diagnostic accuracy measure for diseases with k stages, named maximum absolute determinant.
- To establish the maximum absolute determinant as a criterion for optimal cut-point selection in multi-stage disease diagnosis.
- To provide geometric and probabilistic interpretations of the new measure.
Main Methods:
- Development of the maximum absolute determinant measure for k-stage diseases.
- Geometric and probabilistic interpretation of the proposed measure.
- Power and simulation studies to evaluate performance.
- Application to Alzheimer's Disease Neuroimaging Initiative data.
Main Results:
- The maximum absolute determinant utilizes all classification information, unlike existing measures.
- It serves as an effective criterion for selecting optimal diagnostic cut-points in multi-stage diseases.
- Performance evaluations demonstrate its utility in diagnostic accuracy assessment and cut-point selection.
Conclusions:
- The maximum absolute determinant is a comprehensive and effective measure for evaluating diagnostic accuracy in multi-stage diseases.
- This new measure overcomes limitations of existing methods, particularly in cut-point selection.
- The proposed method shows promise for real-world applications, as demonstrated by the Alzheimer's disease data analysis.
Related Concept Videos
Receiver Operating Characteristic Plot
576
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
576
Sensitivity, Specificity, and Predicted Value
1.8K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
1.8K
Accuracy and Errors in Hypothesis Testing
682
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
682
Accuracy and Precision
3.1K
3.1K
Detection of Gross Error: The Q Test
7.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
7.4K


