Related Experiment Video
Updated: Nov 15, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
A comparison of reweighting estimators of average treatment effects in real world populations
Chen-Yen Lin1, Eloise Kaizar2, Douglas Faries1
1Eli Lilly and Company, Indianapolis, Indiana, USA.
Abstract:
Regulatory agencies typically evaluate the efficacy and safety of new interventions and grant commercial approval based on randomized controlled trials (RCTs). Other major healthcare stakeholders, such as insurance companies and health technology assessment agencies, while basing initial access and reimbursement decisions on RCT results, are also keenly interested in whether results observed in idealized trial settings will translate into comparable outcomes in real world settings-that is, into so-called "real world" effectiveness. Unfortunately, evidence of real world effectiveness for new interventions is not available at the time of initial approval. To bridge this gap, statistical methods are available to extend the estimated treatment effect observed in a RCT to a target population. The generalization is done by weighting the subjects who participated in a RCT so that the weighted trial population resembles a target population. We evaluate a variety of alternative estimation and weight construction procedures using both simulations and a real world data example using two clinical trials of an investigational intervention for Alzheimer's disease. Our results suggest an optimal approach to estimation depends on the characteristics of source and target populations, including degree of selection bias and treatment effect heterogeneity.
Insights
Statistical methods can generalize randomized controlled trial (RCT) findings to real-world populations by weighting trial participants. The best approach depends on population characteristics and selection bias.
Area of Science:
- Biostatistics
- Health Services Research
- Clinical Trial Methodology
Background:
- Regulatory agencies approve interventions based on randomized controlled trials (RCTs).
- Healthcare stakeholders need real-world effectiveness data beyond idealized RCT settings.
- Real-world effectiveness evidence is typically unavailable at the time of initial approval.
Purpose of the Study:
- To evaluate statistical methods for generalizing RCT treatment effects to target populations.
- To identify optimal estimation and weight construction procedures for real-world effectiveness.
Main Methods:
- Utilized weighting procedures to adjust RCT participant data.
- Compared various estimation and weight construction methods.
- Employed simulations and a real-world Alzheimer's disease clinical trial dataset.
Main Results:
- The optimal statistical approach for generalizing RCT results is contingent upon population characteristics.
- Factors influencing the best method include selection bias and treatment effect heterogeneity.
- Demonstrated the application using a real-world Alzheimer's disease intervention study.
Conclusions:
- Statistical generalization methods can bridge the gap between RCT efficacy and real-world effectiveness.
- Careful consideration of source and target population attributes is crucial for accurate estimation.
- Provides guidance for stakeholders seeking to understand intervention performance in diverse populations.
Related Concept Videos
Regression Toward the Mean
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
What are Estimates?
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
Analysis of Population Pharmacokinetic Data
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Bias in Epidemiological Studies

