Related Experiment Video
Updated: Jan 9, 2026

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
Published on: May 13, 2022
A comparison of causal inference methods for evaluating multiple treatment groups
Shuai Chen1, Hao Wu2, Hongwei Zhao3
1Division of Biostatistics, Department of Public Health Sciences, University of California, Davis, Davis, CA, USA.
Abstract:
Causal inference is formulated using the counterfactual framework, enabling direct investigation of causal questions. Causal inference methods can incorporate machine learning techniques into the estimation process, allowing for more flexible models. However, the integration of machine learning methods adds complexity to statistical inference. In this paper, we systematically assess several methods for making causal inference with multiple treatment groups, including the outcome regression, inverse propensity score weighting, double-robust estimators, and their counterparts when employing a super learner in the estimation process, as well as the targeted maximum likelihood estimator (TMLE). We conduct numerical studies with complex data-generating models to evaluate these different estimators. Our results suggest that the double-robust estimator, when combined with machine learning, is the most favourable approach, demonstrating lower biases, a valid variance estimator, and improved coverage probabilities for the 95% confidence interval.
Related Concept Videos
Comparing the Survival Analysis of Two or More Groups
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Randomized Experiments
Simple randomization
Simple...
Cochran's Q Test

