Related Experiment Video
Updated: Oct 22, 2025

An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
Comparative performance of the two pooled cohort equations for predicting atherosclerotic cardiovascular disease
Alessandra M Campos-Staffico1, David Cordwin1, Venkatesh L Murthy2
1Department of Clinical Pharmacy, College of Pharmacy, University of Michigan, Ann Arbor, MI, 48109, USA.
Insights
Both the original and revised Pooled Cohort Equations (PCE) poorly predict atherosclerotic cardiovascular disease (ASCVD) risk. This study found no improvement in accuracy with the revised PCE for real-world patient data.
Area of Science:
- Cardiology
- Epidemiology
- Health Informatics
Background:
- Multivariable algorithms, such as the AHA/ACC Pooled Cohort Equations (PCE), are used to predict atherosclerotic cardiovascular disease (ASCVD) risk.
- A systematic overestimation of risk was identified with the original PCE, leading to the proposal of a revised PCE.
- Accurate ASCVD risk prediction is crucial for identifying high-risk patients and guiding preventative strategies.
Purpose of the Study:
- To compare the accuracy of the original and revised PCE in predicting ASCVD risk.
- To evaluate the performance of both PCE models in a large, real-world patient sample.
- To examine potential effect modification by race and sex on PCE accuracy.
Main Methods:
- Retrospective cohort study of 20,843 patients aged 40-75 without prior ASCVD.
- Comparison of model fit, calibration, and discrimination using metrics like Bayesian Information Criterion (BIC), Hosmer-Lemeshow test, AUC, Brier score, and precision-recall analysis.
- Analysis of race and sex subgroups to assess effect modification.
Main Results:
- Both PCE models demonstrated poor calibration (Hosmer-Lemeshow χ² > 20; p < 0.05) and discrimination (AUC < 0.7).
- The revised PCE showed no significant improvement in discrimination compared to the original PCE (AUC: 0.677 vs 0.679; p = 0.357).
- The original PCE indicated stronger positive risk prediction (ΔBIC > 10) than the revised PCE, despite overlapping calibration curves.
Conclusions:
- Both original and revised PCE exhibit poor calibration and discrimination for ASCVD risk in a real-world patient population.
- The revised PCE did not improve the accuracy of ASCVD risk assessment compared to the original PCE.
- Findings suggest limitations in current PCE models for accurately identifying high-risk individuals for ASCVD.
Background And Aims:
Multivariable algorithms have been developed to predict the risk of atherosclerotic cardiovascular disease (ASCVD) to identify high-risk patients. Shortly after the introduction of the AHA/ACC Pooled Cohort Equations (PCE), a systematic overestimation of risk was identified. As such, a revised PCE was proposed to more accurately assess ASCVD risk. This study aims to compare the accuracy of both PCE in predicting ASCVD risk within a large, real-world patient sample in the US.
Methods:
This retrospective cohort study identified 20,843 patients aged between 40 and 75 years with no previous ASCVD in an academic healthcare system. Model fit, calibration, and discrimination were compared between PCE using Bayesian Information Criterion (BIC), Hosmer-Lemeshow test, area under the ROC curves (AUC), Brier score, and precision-recall analysis. In addition, we examined race and sex subgroups for effect modification.
Results:
Both PCE showed poor calibration (Hosmer-Lemeshow χ2 > 20; p < 0.05) and discrimination (AUC<0.7). The lack of improvement in discrimination of the revised PCE (AUC: 0.677 vs 0.679; p = 0.357) was confirmed with the AUC precision-recall curves (AUCPR: 0.0717 vs 0.0698). In contrast, the AHA/ACC PCE showed a strong positive risk prediction (ΔBIC>10) compared to the revised PCE, although calibration curves had overlapped.
Conclusions:
In this single center analysis, both PCE had poor calibration and discrimination of ASCVD risk in a large, real-world patient sample followed up for over 2 years. There was no evidence of improvement in the accuracy of the revised PCE in assessing the risk of ASCVD in relation to the AHA/ACC PCE.
More Related Videos
Related Concept Videos
Comparing the Survival Analysis of Two or More Groups
Actuarial Approach
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Relative Risk
Atherosclerosis II: Clinical Manifestations and Diagnostic Tests
Pharmacokinetic Models: Comparison and Selection Criterion
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
Odds Ratio

