Related Experiment Video
Updated: Sep 19, 2025

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
Published on: May 13, 2022
Permutation tests for detecting treatment effect heterogeneity in cluster randomized trials
Lara Maleyeff1,2, Fan Li3,4, Sebastien Haneuse2
1Department of Epidemiology, Biostatistics, and Occupational Health, McGill University, Canada.
Abstract:
Cluster randomized trials are widely used in healthcare research for the evaluation of intervention strategies. Beyond estimating the average treatment effect, it is often of interest to assess whether the treatment effect varies across subgroups. While conventional methods based on tests of interaction terms between treatment and covariates can be used to detect treatment effect heterogeneity in cluster randomized trials, they typically rely on parametric assumptions that may not hold in practice. Adapting existing permutation tests from individually randomized trials, however, requires conceptual clarification and modification due to the multiple possible interpretations of treatment effect heterogeneity in the cluster randomized trial context. In this work, we develop variations of permutation tests and clarify key causal definitions in order to assess treatment effect heterogeneity in cluster randomized trials. Our procedure enables investigators to simultaneously test for effect modification across a large number of covariates, while maintaining nominal type I error rates and reasonable power in simulation studies. In the Pain Program for Active Coping and Training (PPACT) study, the proposed methods are able to detect treatment effect heterogeneity that was not identified by conventional methods assessing treatment-covariate interactions.
Related Concept Videos
Test for Homogeneity
Randomized Experiments
Simple randomization
Simple...
Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in...
Behrens–Fisher Test
This test...
McNemar's Test
Hazard Ratio
For example, in a clinical trial...

