Related Experiment Video
Updated: Oct 28, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Using principal components as covariates in propensity score weighting: a simulation study
Yifang Zeng1, Jaehoon Lee2, Seungman Kim3
1Department of Educational Psychology, Leadership, and Counseling, College of Education, Texas Tech University, Lubbock, TX, 79409, USA.
Background:
Propensity score weighting (PSW) is widely employed to reduce confounding bias in observational studies. The specification of the propensity score (PS) model-particularly the selection of covariates-significantly affects the accuracy of treatment effect estimates. Although conventional guidance recommends an "all-inclusive" approach that incorporates all available covariates, this strategy can be impractical in high-dimensional datasets and may introduce computational problems such as multicollinearity and complete or quasi-complete separation. This study introduces and evaluates three alternative strategies that leverage principal component analysis (PCA) to mitigate these challenges.
Methods:
A Monte Carlo simulation was conducted to compare the traditional all-inclusive approach against three PCA-based covariate selection strategies in terms of model stability and bias reduction.
Results:
We found that PCA-based strategies consistently produced more stable PS models and more accurate, less-biased treatment effect estimates-particularly when the number of correlated covariates was large. Specifically, incorporating the minimum set of principal components needed to explain approximately 40% of total covariate variance provided the optimal trade-off between dimensionality reduction and confounding adjustment.
Conclusions:
The study findings highlight PCA as a practical and computationally efficient solution for improving PS estimation in complex observational studies. Effective covariate selection for PS models requires identifying variables that are associated with both treatment assignment and the outcome.
Related Concept Videos
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Friedman Two-way Analysis of Variance by Ranks
Goodness-of-Fit Test
Parametric Survival Analysis: Weibull and Exponential Methods
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
