Related Experiment Video
Updated: May 28, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Assessing the sensitivity of methods for estimating principal causal effects
Elizabeth A Stuart1, Booil Jo2
1Departments of Mental Health and Biostatistics, Johns Hopkins Bloomberg School of Public Health, 624 N Broadway, 8th Floor, Baltimore, MD, USA. estuart@jhsph.edu.
Estimating treatment effects for compliers (CACE) involves complex methods. This study compares two CACE estimation techniques, finding the exclusion restriction method less sensitive to assumption violations, especially with strong compliance predictors.
Area of Science:
- Causal inference
- Statistical methodology
- Biostatistics
Background:
- Principal stratification framework allows analyzing treatment effects based on compliance.
- Complier Average Causal Effect (CACE) is a key estimand but its estimation is challenging.
- Existing CACE estimation methods have varied assumptions and limited guidance for researchers.
Purpose of the Study:
- To compare two distinct methods for estimating CACE: a maximum likelihood (joint) method assuming the exclusion restriction (ER) and a propensity score-based method assuming principal ignorability.
- To assess the sensitivity of each method to its own assumptions and the assumptions of the alternative method.
- To provide guidance on selecting appropriate CACE estimation procedures.
Main Methods:
- Detailed examination of the assumptions underlying the maximum likelihood (joint) method and the propensity score-based method.
- Sensitivity analysis using simulated data to evaluate method performance under assumption violations.
- Application to a motivating real-world example.
Main Results:
- The exclusion restriction (ER)-based joint method demonstrated greater robustness to its own assumptions compared to the propensity score method.
- Both methods showed improved performance when strong predictors of compliance were present.
- Each method performed well when the assumptions of the other method were violated.
Conclusions:
- The choice of CACE estimation method should be guided by the likelihood of satisfying its underlying assumptions in a specific research context.
- Strong predictors of principal stratum membership significantly enhance the performance of CACE estimation methods.
- Researchers should carefully consider method-specific assumptions and potential violations when estimating CACE.
Related Concept Videos
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Criteria for Causality: Bradford Hill Criteria - II
Causality in Epidemiology
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Criteria for Causality: Bradford Hill Criteria - I
Statistical Methods for Analyzing Epidemiological Data