Related Experiment Video
Updated: Jun 26, 2026

Establishing a Competing Risk Regression Nomogram Model for Survival Data
Published on: October 23, 2020
Monitoring risk-adjusted outcomes in congenital heart surgery: does the appropriateness of a risk model change with
Victor T Tsang1, Katherine L Brown, Mats Johanssen Synnergren
1Cardiac Unit, Great Ormond Street Hospital, London, United Kingdom. tsangv@gosh.nhs.uk
Insights
Pediatric congenital heart surgery risk models need regular recalibration. Outcomes improved, showing the original risk model became outdated, highlighting the need for updated risk adjustment in surgical audits.
Area of Science:
- Pediatric Cardiac Surgery
- Health Outcomes Research
- Biostatistics
Background:
- Risk adjustment in pediatric congenital heart surgery is complex due to diverse diagnoses and procedures.
- Variable life-adjusted display (VLAD) charts effectively present risk-adjusted outcomes.
- The long-term appropriateness of existing risk models requires ongoing evaluation.
Purpose of the Study:
- To assess the performance of a previously developed risk model over time.
- To compare predicted risk distributions between two patient cohorts.
- To evaluate risk-adjusted outcomes using VLAD charts for a recent period.
Main Methods:
- Utilized a graphic technique to evaluate an existing risk model with data from 2000-2003.
- Compared predicted risk distributions between patients from 2000-2003 and 2004-2006.
- Constructed a VLAD chart for risk-adjusted outcomes in the 2004-2006 cohort.
Main Results:
- The risk model accurately predicted mortality above 3% but underestimated it between 2-3% and overestimated it below 2%.
- Little difference was observed in predicted risk distributions between the 2000-2003 and 2004-2006 patient groups.
- Observed outcomes in 2004-2006 were significantly better than predicted by the existing risk model, independent of case-mix changes.
Conclusions:
- Risk adjustment models can become outdated over time.
- Regular recalibration of risk models is essential for accurate surgical audits.
- Complacency in risk-adjusted audits is a risk if models are not updated to reflect evolving standards and expectations.
Background:
Risk adjustment of outcomes in pediatric congenital heart surgery is challenging due to the great diversity in diagnoses and procedures. We have previously shown that variable life-adjusted display (VLAD) charts provide an effective graphic display of risk-adjusted outcomes in this specialty. A question arises as to whether the risk model used remains appropriate over time.
Methods:
We used a recently developed graphic technique to evaluate the performance of an existing risk model among those patients at a single center during 2000 to 2003 originally used in model development. We then compared the distribution of predicted risk among these patients with that among patients in 2004 to 2006. Finally, we constructed a VLAD chart of risk-adjusted outcomes for the latter period.
Results:
Among 1083 patients between April 2000 and March 2003, the risk model performed well at predicted risks above 3%, underestimated mortality at 2% to 3% predicted risk, and overestimated mortality below 2% predicted risk. There was little difference in the distribution of predicted risk among these patients and among 903 patients between June 2004 and October 2006. Outcomes for the more recent period were appreciably better than those expected according to the risk model. This finding cannot be explained by any apparent bias in the risk model combined with changes in case-mix.
Conclusions:
Risk models can, and hopefully do, become out of date. There is scope for complacency in the risk-adjusted audit if the risk model used is not regularly recalibrated to reflect changing standards and expectations.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Comparing the Survival Analysis of Two or More Groups
Relative Risk
Actuarial Approach
Consider the example of a high-risk surgical procedure with significant early-stage mortality. A two-year clinical study is conducted,...
Impact of Pharmacokinetic–Pharmacodynamic Models: Regulatory Decisions
Assumptions of Survival Analysis