Related Experiment Video
Updated: Feb 28, 2026

An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
An EM algorithm for nonparametric estimation of the cumulative incidence function from repeated imperfect test
Birgit I Witte1, Johannes Berkhof1, Marianne A Jonker1,2
1Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, The Netherlands.
This study introduces an expectation-maximization algorithm for estimating cumulative incidence functions with imperfect screening tests. The method improves accuracy and reduces bias in interval-censored event time data.
Area of Science:
- Biostatistics
- Epidemiology
- Medical Screening
Background:
- Event times in screening and surveillance are often interval censored.
- Imperfect screening tests introduce uncertainty into event time intervals.
Purpose of the Study:
- To develop a nonparametric maximum likelihood estimator for cumulative incidence functions using screening test data.
- To address challenges posed by interval censoring and imperfect screening tests.
Main Methods:
- An expectation-maximization algorithm was developed for estimating cumulative incidence.
- The algorithm features a closed-form solution for combined expectation and maximization steps.
- The method is computationally efficient and undemanding.
Main Results:
- A simulation study showed estimator bias approaches zero with large sample sizes.
- The proposed estimator demonstrated lower mean squared error compared to methods assuming perfect screening.
- The algorithm was successfully applied to cervical precancer follow-up data.
Conclusions:
- The developed expectation-maximization algorithm provides a robust method for analyzing interval-censored event time data with imperfect screening.
- This approach offers improved accuracy in estimating cumulative incidence functions in real-world screening scenarios.
- The findings have implications for surveillance and follow-up studies in various medical fields.
Related Concept Videos
Kaplan-Meier Approach
Expected Frequencies in Goodness-of-Fit Tests
Parametric Survival Analysis: Weibull and Exponential Methods
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
The Anderson-Darling Test
Goodness-of-Fit Test

