Related Experiment Video
Updated: Jul 26, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
On the Q statistic with constant weights in meta-analysis of binary outcomes
Elena Kulinskaya1, David C Hoaglin2
1School of Computing Sciences, University of East Anglia, Norwich Research Park, NR4 7TJ, Norwich, UK. e.kulinskaya@uea.ac.uk.
This study introduces a new Q statistic for meta-analysis heterogeneity testing, using sample sizes instead of estimated variances. Recommended approximations improve accuracy for log-odds-ratio, log-relative-risk, and risk difference measures.
Area of Science:
- Biostatistics
- Medical Research Methodology
- Statistical Modeling
Background:
- Cochran's Q statistic is standard for meta-analysis heterogeneity testing.
- Current methods often use estimated variances in weights, complicating distribution approximations.
- This complexity impacts the accuracy of between-study variance estimators.
Approach:
- Investigated an alternative Q statistic using constant weights based on sample sizes.
- Evaluated distribution approximations for this new statistic and the standard Q statistic via simulation.
- Focused on log-odds-ratio (LOR), log-relative-risk (LRR), and risk difference (RD) effect measures.
Key Points:
- For LOR and LRR, gamma and Farebrother approximations are effective for the new Q statistic.
- For RD, the Farebrother approximation shows excellent performance across sample sizes.
- The standard chi-square approximation for Q is inadequate for all three binary effect measures.
Conclusions:
- The standard chi-square approximation for Q is unreliable for binary effect measures.
- Recommended alternative approximations for heterogeneity testing based on the new Q statistic.
- Provided practical guidelines for selecting appropriate tests at the 0.05 significance level.
Related Concept Videos
One-Way ANOVA: Unequal Sample Sizes
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Test for Homogeneity
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Friedman Two-way Analysis of Variance by Ranks

