Related Experiment Video
Updated: Jun 21, 2025

An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
Extending the DeLong algorithm for comparing areas under correlated receiver operating characteristic curves with
Lily Zou1, Yun-Hee Choi2, Leonardo Guizzetti2
1Department of Statistics and Actuarial Science, University of Waterloo, Waterloo, Ontario, Canada.
The DeLong method for comparing receiver operating characteristic curves can produce invalid results by omitting data with missing values. This study introduces a novel, valid, and efficient approach to handle missing data in these comparisons.
Area of Science:
- Biostatistics
- Statistical Methods
- Medical Data Analysis
Background:
- The DeLong method (1988) is widely used for comparing areas under correlated receiver operating characteristic (ROC) curves.
- Existing software implementations of the DeLong method may produce invalid or inefficient results by excluding individuals with any missing data.
- Missing data is a common issue in real-world datasets, necessitating robust statistical approaches.
Purpose of the Study:
- To address the limitations of the DeLong method concerning missing data.
- To develop a simplified and more robust algorithm for comparing areas under correlated ROC curves.
- To provide a valid and efficient method for handling missing data in multivariate ROC analyses.
Main Methods:
- A simplified version of the DeLong algorithm using ranks was developed.
- A mixed-model approach was employed to extend the algorithm for multivariate data with missing values.
- The proposed procedure was validated through simulation studies for data missing at random.
Main Results:
- Simulation results confirmed the validity and efficiency of the proposed procedure.
- The new method effectively accommodates missing data, overcoming limitations of the original DeLong approach.
- The procedure demonstrated superior performance in handling datasets with missing values compared to standard implementations.
Conclusions:
- The proposed mixed-model approach provides a valid and efficient alternative for comparing areas under correlated ROC curves with missing data.
- This method enhances the reliability of statistical analyses in the presence of incomplete datasets.
- The procedure is illustrated and available in popular statistical software (SAS, Stata, R).
Related Concept Videos
Receiver Operating Characteristic Plot
Comparing the Survival Analysis of Two or More Groups
Kaplan-Meier Approach
Critical Region, Critical Values and Significance Level
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the...
Truncation in Survival Analysis
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Cancer Survival Analysis

