Related Experiment Videos
Primary study authors of significant studies are more likely to believe that a strong association exists in a
Orestis A Panagiotou1, John P A Ioannidis
1Department of Hygiene and Epidemiology, Clinical and Molecular Epidemiology Unit and Clinical Trials and Evidence-Based Medicine Unit, University of Ioannina School of Medicine, Ioannina 45110, Greece.
Objective:
To assess the interpretation of a highly heterogeneous meta-analysis by authors of primary studies and by methodologists.
Study Design And Setting:
We surveyed the authors of studies on the association between insulin-like growth factor 1 (IGF-1) and prostate cancer, and 20 meta-analysis methodologists. Authors and methodologists presented with the respective meta-analysis results were queried about the effect size and potential causality of the association. We evaluated whether author responses correlated with the number of IGF-related articles they had published and their study results included in the meta-analysis. We also compared authors' and methodologists' responses.
Results:
Authors who had published more IGF-related papers offered more generous effect size estimates for the association (ρ(s)=0.61, P=0.01) and higher likelihood that the odds ratio (OR) was greater than 1.20 (ρ(s)=0.63, P=0.01). Authors who had published themselves studies with statistically significant effects for a positive association were more likely to believe that the true OR is greater than 1.20 compared with methodologists (median likelihood 50% versus 2.5%, P=0.01).
Conclusion:
Researchers are influenced by their own investment in the field, when interpreting a meta-analysis that includes their own study. Authors who published significant results are more likely to believe that a strong association exists compared with methodologists.
Related Concept Videos
Statistical Significance
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Bias in Epidemiological Studies
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Statistical Hypothesis Testing
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...