Evaluation of the survival-inferred fragility index to assess the robustness of the estimated treatment effect on survival endpoints

  • 0ECSTRRA Team IRSL, INSERM UMR 1342, Université Paris Cité, 1 Ave Claude Vellefaux, Paris 75010, France.

|

|

Summary

This summary is machine-generated.

The survival inferred fragility index (SIFI) is unreliable for assessing treatment robustness in cancer trials. Its calculation is sensitive to patient selection, particularly those at survival extremes, and should not be used as a primary measure.

Area Of Science

  • Biostatistics
  • Clinical Trial Design
  • Survival Analysis

Background

  • Phase III randomized clinical trials (RCTs) commonly assess cancer treatment efficacy using p-values from logrank tests on right-censored endpoints.
  • The survival inferred fragility index (SIFI) was recently proposed to measure the robustness of treatment effects in these trials.
  • Initial applications of SIFI to real-world RCTs yielded unexpectedly low values, suggesting potential issues with its methodology.

Purpose Of The Study

  • To investigate the reliability of the survival inferred fragility index (SIFI) as a measure of treatment effect robustness in cancer clinical trials.
  • To evaluate the impact of sample characteristics, including patient selection and censoring, on SIFI values.
  • To determine if SIFI is a valid and robust metric for assessing treatment efficacy in oncology research.

Main Methods

  • A simulation study was conducted using realistic scenarios for randomized clinical trials.
  • Survival times were generated under varying treatment effects, sample sizes, and censoring proportions.
  • The study specifically examined the effect of sample contamination with individuals having extreme prognoses on SIFI values.

Main Results

  • The standard SIFI demonstrated low values and poor sensitivity to sample size under the null hypothesis of no treatment effect.
  • Both p-values and the degree of censoring significantly influenced SIFI values under both null and alternative hypotheses.
  • Randomly selecting patients, rather than focusing on survival tails, substantially altered results, often precluding SIFI calculation under the null hypothesis.

Conclusions

  • The survival inferred fragility index (SIFI) is not a reliable measure of robustness for survival trials due to its sensitivity to specific patient subgroups.
  • SIFI values are heavily influenced by the selection of patients, particularly those at the extremes of survival.
  • Recommendations include using random patient selection for SIFI calculation or reconsidering its use altogether in survival trial analysis.

Related Concept Videos

Comparing the Survival Analysis of Two or More Groups 01:20

107

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...

Assumptions of Survival Analysis 01:15

76

Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.

Survival Times Are Positively Skewed
 Survival times often exhibit positive skewness, unlike the normal distribution assumed...

Survival Curves 01:18

82

Survival curves are graphical representations that depict the survival experience of a population over time, offering an intuitive way to track the proportion of individuals who remain event-free at each time point. These curves are widely used in fields such as medicine, public health, and reliability engineering to visualize and compare survival probabilities across different groups or conditions.
The Kaplan-Meier estimator is the most common method for constructing survival curves. This...

Kaplan-Meier Approach 01:24

67

The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...

The Mantel-Cox Log-Rank Test 01:19

258

The Mantel-Cox log-rank test is a widely used statistical method for comparing the survival distributions of two groups. It tests whether a statistically significant difference exists in survival times between the groups without assuming a specific distribution for the survival data, making it a non-parametric test. This flexibility makes the log-rank test particularly valuable in medical research and other fields where the timing of an event, such as death or disease recurrence, is of...

Introduction To Survival Analysis 01:18

144

Survival analysis is a statistical method used to study time-to-event data, where the "event" might represent outcomes like death, disease relapse, system failure, or recovery. A unique feature of survival data is censoring, which occurs when the event of interest has not been observed for some individuals during the study period. This requires specialized techniques to handle incomplete data effectively.
The primary goal of survival analysis is to estimate survival time—the time...