Potential bias in efficacy estimates due to intercurrent treatment discontinuations

Bjorn Redfors1,2, Jacky Choi1, Mario Gaudino3

  • 1Department of Population Health Sciences, Weill Cornell Medicine, 425 East 61st Street, NewYork, NY 10065, USA.

Insights

Treatment discontinuation in randomized clinical trials (RCTs) is common and can bias results. Addressing it as an intercurrent event improves trial validity and interpretation, especially in antithrombotic studies.

Area of Science:

  • Clinical Trials Methodology
  • Biostatistics
  • Pharmacovigilance

Background:

  • Treatment discontinuation is a frequent, underrecognized issue in randomized clinical trials (RCTs) that can introduce bias into treatment effect estimates.
  • Antithrombotic trials frequently experience treatment discontinuation due to bleeding, often in patients susceptible to ischemic events, highlighting the need for careful analysis.

Purpose of the Study:

  • To assess the reporting and analytical handling of treatment discontinuation in antithrombotic RCTs.
  • To examine the impact of discontinuation patterns on efficacy estimates using simulations under various scenarios.
  • To compare treatment policy and while-on-treatment strategies within the ICH E9(R1) framework.

Main Methods:

  • Review of large antithrombotic RCTs published between 2020-2025 in The New England Journal of Medicine.
  • Simulation studies modeling discontinuation in treatment and control arms under different conditions (e.g., similar patterns, outcome-associated).
  • Comparison of intention-to-treat (ITT) and per-protocol (PP) analyses, considering treatment policy and while-on-treatment approaches.

Main Results:

  • Approximately one-third of patients discontinued treatment in trials exceeding six months, with greater imbalance in open-label studies.
  • Over half of discontinuations were safety-related; however, timing and temporary interruptions were infrequently reported.
  • Per-protocol analyses, assuming non-informative censoring, generally produced larger efficacy estimates than intention-to-treat analyses. Simulations revealed bias in treatment policy and while-on-treatment strategies when discontinuation was outcome-associated.

Conclusions:

  • Treatment discontinuation is a common, prognostically significant event often oversimplified in analyses, potentially compromising RCT validity.
  • Explicitly defining discontinuation as an intercurrent event within the estimand framework is crucial for robust trial interpretation.
  • Utilizing stratified outcome curves, such as Simon-Makuch curves, can help identify prognostic discontinuation patterns and improve the interpretation of trial findings.
Abstract

Related Concept Videos

Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
Blind Procedures02:07

Blind Procedures

Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
The Placebo Effect01:54

The Placebo Effect

The placebo effect occurs when people's expectations or beliefs influence or determine their experience in a given situation. In other words, simply expecting something to happen can actually make it happen.
Bias01:22

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...