Related Experiment Video
Updated: Jul 2, 2025

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Comparison of bias adjustment in meta-analysis using data-based and opinion-based methods
Jennifer C Stone1, Luis Furuya-Kanamori2, Edoardo Aromataris1
1JBI, Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA, Australia.
Comparing bias adjustment methods in meta-analysis, this study found opinion-based approaches add uncertainty. Data-based and quality effects methods offered minor bias adjustments, aligning with inverse variance heterogeneity models.
Area of Science:
- Biostatistics
- Meta-analysis methodology
Background:
- Existing meta-analysis bias adjustment methods lack comprehensive comparison with unadjusted approaches.
- This study addresses this gap by evaluating six bias adjustment techniques against two unadjusted models.
Approach:
- Re-analyzed a meta-analysis of 10 randomized controlled trials.
- Employed two data-based methods (Welton's, Doi's quality effects model) and four opinion-informed methods.
- Compared results against DerSimonian-Laird random effects and Doi's inverse variance heterogeneity models.
Key Points:
- Opinion-based methods increased uncertainty in random effects model estimates.
- Data-based and quality effects methods yielded distinct results.
- These methods showed alignment with the inverse variance heterogeneity model, with slight downward bias adjustment.
Conclusions:
- Opinion-based methods appear to introduce uncertainty rather than effectively adjust for bias.
- Data-based methods provide a more nuanced approach to bias adjustment in meta-analysis.
Related Concept Videos
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Bias in Epidemiological Studies
Blind Procedures
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
The Anchoring-and-Adjustment Heuristic

