Related Experiment Video
Updated: Jun 22, 2025

Machine Learning Algorithms for Early Detection of Bone Metastases in an Experimental Rat Model
Published on: August 16, 2020
Statistical Methods for Comparing Predictive Values in Medical Diagnosis.
Chanrim Park1, Seo Young Park2, Hwa Jung Kim3,4
1Biomedical Research Institute, Seoul National University Hospital, Seoul, Republic of Korea.
Comparing diagnostic test performance, especially predictive values, is challenging. This study introduces the permutation test as a robust method for evaluating diagnostic accuracy, particularly for small datasets in breast cancer diagnosis.
Area of Science:
- Medical diagnostics
- Statistical analysis
- Artificial intelligence in healthcare
Background:
- Evaluating binary diagnostic tests requires sensitivity, specificity, and predictive values.
- Comparing predictive values between tests on the same patients poses statistical challenges due to outcome-dependent denominators.
- Accurate comparison is vital for selecting superior diagnostic methods, especially in fields like breast cancer detection.
Purpose of the Study:
- To review existing statistical methods for comparing predictive values of diagnostic tests.
- To propose and evaluate the permutation test as a suitable method for comparing predictive values.
- To demonstrate the application of these methods using a breast cancer diagnostic dataset.
Main Methods:
- Review of statistical techniques for comparing diagnostic test performance metrics.
- Application of the permutation test, a non-parametric approach, for comparing positive and negative predictive values.
- Utilizing a dataset from breast cancer diagnosis involving MRI and mammography/ultrasound combined modalities.
Main Results:
- Existing methods for comparing predictive values present statistical complexities.
- The permutation test offers an intuitive and non-parametric approach to comparing predictive values.
- The study demonstrates the practical application of the permutation test on real-world diagnostic data.
Conclusions:
- The permutation test is a valuable tool for comparing predictive values in diagnostic accuracy studies.
- This method is particularly useful for small sample sizes and complex comparisons.
- The findings aid in selecting more accurate diagnostic strategies for breast cancer and other conditions.
Related Concept Videos
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Receiver Operating Characteristic Plot
Comparing the Survival Analysis of Two or More Groups
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Statistical Methods for Analyzing Epidemiological Data
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...

