Related Experiment Video
Updated: Aug 18, 2026

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials
Published on: April 19, 2024
Inflation of type I error rate in two statistical tests for the detection of publication bias in meta-analyses with
Guido Schwarzer1, Gerd Antes, Martin Schumacher
1Freiburg Center for Data Analysis and Modelling, University of Freiburg, Germany. sc@fdm.uni-freiburg.de
Abstract:
The use of meta-analysis to combine results of several trials is still increasing in the medical field. The validity of a meta-analysis may be affected by various sources of bias (for example, publication bias, language bias). Therefore, an analysis of bias should be an integral part of any systematic review. Statistical tests and graphical methods have been developed for this purpose. In this paper, two statistical tests for the detection of bias in meta-analysis were investigated in a simulation study. Binary outcome data, which are very common in medical applications, were considered and relative effect measures (odds ratios, relative risk) were used for pooling. Sample sizes were generated according to findings in a survey of eight German medical journals. Simulation results indicate an inflation of type I error rates for both tests when the data are sparse. Results get worse with increasing treatment effect and number of trials combined. Valid statistical tests for the detection of bias in meta-analysis with sparse data need to be developed.
Related Concept Videos
Types of Hypothesis Testing
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p ≠ 0.5.
Errors In Hypothesis Tests
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Significance Testing: Overview
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...