Related Experiment Video
Updated: Jul 2, 2025
Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Comparison of bias adjustment in meta-analysis using data-based and opinion-based methods
Jennifer C Stone1, Luis Furuya-Kanamori2, Edoardo Aromataris1
1JBI, Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, SA, Australia.
Introduction:
Several methods exist for bias adjustment of meta-analysis results, but there has been no comprehensive comparison with unadjusted methods. We compare 6 bias-adjustment methods with 2 unadjusted methods to examine how these different methods perform.
Methods:
We re-analyzed a meta-analysis that included 10 randomized controlled trials. Two data-based methods (Welton's data-based approach and Doi's quality effects model) and 4 opinion-informed methods (opinion-based approach, opinion-based distributions combined statistically with data-based distributions, numerical opinions informed by data-based distributions, and opinions obtained by selecting areas from data-based distributions) were used to incorporate methodological quality information into the meta-analytical estimates. The results of these 6 methods were compared with 2 unadjusted models: the DerSimonian-Laird random effects model and Doi's inverse variance heterogeneity model.
Results:
The 4 opinion-based methods returned the random effects model estimates with wider uncertainty. The data-based and quality effects methods returned different results and aligned with the inverse variance heterogeneity method with some minor downward bias adjustment.
Conclusion:
Opinion-based methods seem to only add uncertainty rather than bias adjust.
Related Concept Videos
01:22Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
01:29Bias in Epidemiological Studies
02:07Blind Procedures
01:25Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
01:25The Anchoring-and-Adjustment Heuristic