Related Experiment Video
Updated: May 7, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Quantifying absolute treatment effect heterogeneity for time-to-event outcomes across different risk strata:
Background:
Risk-based analyses are increasingly popular for understanding heterogeneous treatment effects (HTE) in clinical trials. For time-to-event analyses, the assumption that high-risk patients benefit most on the clinically important absolute scale when hazard ratios (HRs) are constant across risk strata might not hold. Absolute treatment effects can be measured as either the risk difference (RD) at a given time point or the difference in restricted mean survival time (ΔRMST) which aligns more closely with utilitarian medical decision-making frameworks. We examined risk-based HTE analyses strata in time-to-event analyses to identify the patterns of absolute HTE across risk strata, and whether ΔRMST may lead to more meaningful treatment decisions than RD.
Methods:
Using artificial and empirical time-to-event data, we compared RD-the difference between Kaplan-Meier estimates at a certain time point-and ΔRMST-the area between the Kaplan-Meier curves-across risk strata and show how these metrics can prioritize different subgroups for treatment. We explored scenarios involving constant HRs while varying both the overall event rates and the discrimination of the risk models.
Results:
When event rates and discrimination were low, RD and ΔRMST increased monotonically, with high-risk patients benefitting more than low-risk patients. As the event rate increased and/or discrimination increased: 1) a "sweet spot" pattern emerged: intermediate-risk patients benefit more than low-risk and high-risk patients; and 2) RD understates the benefit in high-risk patients.
Conclusions:
The pattern of HTE characterized by RD may diverge substantially from ΔRMST, potentially leading to treatment mistargeting. Therefore, we recommend ΔRMST for assessing absolute HTE in time-to-event data.
Key Messages:
To quantify absolute heterogeneous treatment effect (HTE) in time-to-event data, the difference in restricted mean survival time (ΔRMST) is more intuitive and comprehensive, less dependent on the time horizon, and better captures HTE when the hazard ratio (HR) of treatment varies over time, compared to the risk difference (RD).We examined risk-based HTE analyses in time-to-event analyses to identify the patterns of absolute HTE across different risk strata, and whether ΔRMST may lead to more meaningful treatment decisions than RD.Even with a constant HR, intermediate-risk patients may benefit more than low-risk and high-risk patients as event rates increase, a phenomenon known as a "sweet spot" pattern.The RD does not accurately reflect the benefit for high-risk patients when event rates and/or discrimination of the risk model are high, unlike to the ΔRMST.We recommend the ΔRMST for assessing absolute HTE, as the RD may potentially lead to treatment mistargeting.
Related Concept Videos
Comparing the Survival Analysis of Two or More Groups
Hazard Ratio
For example, in a clinical trial...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Introduction To Survival Analysis
The primary goal of survival analysis is to estimate survival time—the time...
Assumptions of Survival Analysis

