Related Experiment Video
Updated: Jul 25, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Using Balancing Weights to Target the Treatment Effect on the Treated when Overlap is Poor
1From the Heinz College of Information Systems and Public Policy and Department of Statistics, Carnegie Mellon University, Pittsburgh, PA.
Abstract:
Inverse probability weights are commonly used in epidemiology to estimate causal effects in observational studies. Researchers often focus on either the average treatment effect or the average treatment effect on the treated with inverse probability weighting estimators. However, poor overlap in the baseline covariates between the treated and control groups can produce extreme weights that can result in biased treatment effect estimates. One alternative to inverse probability weights are overlap weights, which target the population with the most overlap on observed covariates. Although estimates based on overlap weights produce less bias in such contexts, the causal estimand can be difficult to interpret. An alternative to model-based inverse probability weights are balancing weights, which directly target imbalances during the estimation process, rather than model fit. Here, we explore whether balancing weights allow analysts to target the average treatment effect on the treated in cases where inverse probability weights lead to biased estimates due to poor overlap. We conduct three simulation studies and an empirical application. We find that balancing weights often allow the analyst to still target the average treatment effect on the treated even when overlap is poor. We show that although overlap weights remain a key tool, more familiar estimands can sometimes be targeted by using balancing weights.
Related Concept Videos
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Regression Toward the Mean
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Confounding in Epidemiological Studies
Blind Procedures
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...

