Related Experiment Video
Updated: Aug 29, 2025
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
Performance of model-based vs. permutation tests in the HEALing (Helping to End Addiction Long-termSM) Communities
Xiaoyu Tang1, Timothy Heeren2, Philip M Westgate3
1Department of Biostatistics, Boston University School of Public Health, 801 Massachusetts Avenue, Boston, MA, 02219, USA. rainie@bu.edu.
Background:
The HEALing (Helping to End Addiction Long-termSM) Communities Study (HCS) is a multi-site parallel group cluster randomized wait-list comparison trial designed to evaluate the effect of the Communities That Heal (CTH) intervention compared to usual care on opioid overdose deaths. Covariate-constrained randomization (CCR) was applied to balance the community-level baseline covariates in the HCS. The purpose of this paper is to evaluate the performance of model-based tests and permutation tests in the HCS setting. We conducted a simulation study to evaluate type I error rates and power for model-based and permutation tests for the multi-site HCS as well as for a subgroup analysis of a single state (Massachusetts). We also investigated whether the maximum degree of imbalance in the CCR design has an impact on the performance of the tests.
Methods:
The primary outcome, the number of opioid overdose deaths, is count data assessed at the community level that will be analyzed using a negative binomial regression model. We conducted a simulation study to evaluate the type I error rates and power for 3 tests: (1) Wald-type t-test with small-sample corrected empirical standard error estimates, (2) Wald-type z-test with model-based standard error estimates, and (3) permutation test with test statistics calculated by the difference in average residuals for the two groups.
Results:
Our simulation results demonstrated that Wald-type t-tests with small-sample corrected empirical standard error estimates from the negative binomial regression model maintained proper type I error. Wald-type z-tests with model-based standard error estimates were anti-conservative. Permutation tests preserved type I error rates if the constrained space was not too small. For all tests, the power was high to detect the hypothesized 40% reduction in opioid overdose deaths for the intervention vs. comparison group both for the overall HCS and the subgroup analysis of Massachusetts (MA).
Conclusions:
Based on the results of our simulation study, the Wald-type t-test with small-sample corrected empirical standard error estimates from a negative binomial regression model is a valid and appropriate approach for analyzing cluster-level count data from the HEALing Communities Study.
Trial Registration:
ClinicalTrials.gov http://www.
Clinicaltrials:
gov ; Identifier: NCT04111939.
More Related Videos
14:14The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
Published on: May 13, 2022
07:13Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
Published on: April 18, 2025
Related Concept Videos
01:20Comparing the Survival Analysis of Two or More Groups
01:13Randomized Experiments
Simple randomization
Simple...
01:17Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in...
01:23Test for Homogeneity
01:19The Mantel-Cox Log-Rank Test
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...