Related Experiment Video
Updated: May 9, 2026
10:24
Generation of Heterogeneous Drug Gradients Across Cancer Populations on a Microfluidic Evolution Accelerator for Real-Time Observation
Published on: September 19, 2019
Randomized Trials Built on Sand: Examples from COPD, Hormone Therapy, and Cancer
1Center for Clinical Epidemiology, Lady Davis Institute, Jewish General Hospital, and Departments of Epidemiology and Biostatistics, and of Medicine, McGill University, Montreal, Canada.
Rambam Maimonides Medical Journal
|August 3, 2013
Summary
Observational studies may overestimate drug benefits due to biases like immortal time bias. Proper statistical analysis is crucial for accurate assessment of new drug indications and outcomes.
Area of Science:
- Pharmacology
- Biostatistics
- Epidemiology
Background:
- Randomized controlled trials (RCTs) are standard for drug approval.
- Observational studies inform post-marketing surveillance and identify new drug indications.
- Previous observational studies suggested benefits for hormone replacement therapy (HRT) and metformin, later challenged by RCTs.
Purpose of the Study:
- To demonstrate how time-related biases, specifically immortal time bias, can exaggerate drug benefits in observational studies.
- To highlight the importance of rigorous statistical analysis in observational research.
- To caution against initiating expensive trials based solely on potentially biased observational data.
Main Methods:
- Analysis of observational studies in chronic obstructive pulmonary disease (COPD), HRT, and cancer.
- Identification and explanation of time-related biases, including immortal time bias.
- Discussion of how proper statistical methods can mitigate these biases.
Main Results:
- Time-related biases, such as immortal time bias, significantly inflate the perceived benefits of drugs in observational studies.
- These exaggerated effects, observed in studies on COPD, HRT, and cancer, diminish with appropriate statistical adjustments.
- The findings suggest that initial observational evidence for new indications may be misleading.
Conclusions:
- Observational studies are valuable but require careful design and analysis to prevent bias.
- Time-related biases can lead to erroneous conclusions about drug efficacy and safety.
- Scientific evidence for new drug indications from observational studies must be critically evaluated before large-scale RCTs are undertaken.
Related Concept Videos
01:13Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
01:12Hazard Ratio
The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial evaluating a...
For example, in a clinical trial evaluating a...
01:11Blinding
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
01:15Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Bioequivalence experimental study designs play a pivotal role in testing the effectiveness of various treatments. Key among these are the repeated measures, cross-over, carry-over, and Latin square designs. In the repeated measures design, each subject receives all treatments, allowing for temporal comparisons. This type of design is useful in reducing variability but requires careful planning to avoid bias.The cross-over design, an economical method, involves sequential administration of...
01:16Clinical Trials
Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
There are four phases in a clinical trial. A phase one...
01:16Crossover Experiments
Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.