Related Experiment Video
Updated: May 28, 2026

In Silico Clinical Trials for Cardiovascular Disease
Published on: May 27, 2022
Magnitude of effects in clinical trials published in high-impact general medical journals
Konstantinos C M Siontis1, Evangelos Evangelou, John P A Ioannidis
1Clinical Trials and Evidence-Based Medicine Unit, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece.
Insights
High-impact journals publish more favorable results for small experimental intervention trials, especially early ones. Large trials show no difference in effect sizes regardless of journal prestige.
Area of Science:
- Medical research publication bias
- Clinical trial reporting standards
- Scientific journal impact
Background:
- Prestigious journals prioritize important and informative studies.
- Investigated potential bias in high-impact general (HIG) medical journals regarding experimental intervention results.
Purpose of the Study:
- To determine if HIG journals systematically publish more favorable results for experimental interventions compared to other literature.
- To analyze the influence of trial size and publication timing on reported effect sizes in HIG journals.
Main Methods:
- Systematic review of Cochrane Database and meta-analyses from four general journals (2008-09).
- Included meta-analyses with ≥1 binary outcome and ≥1 clinical trial.
- Compared effect sizes from trials in NEJM, JAMA, or Lancet with those in other journals using summary relative odds ratios (sRORs).
Main Results:
- Analyzed 79 meta-analyses comprising 1043 trials.
- Trials in HIG journals showed similar effects to others for large-scale evidence.
- Small trials (<40 events) in HIG journals had more favorable results (sROR 1.64).
- Early small trials in HIG journals showed the most prominent effect inflation (sROR 2.68).
Conclusions:
- Small trials in prestigious journals report more favorable experimental intervention effects.
- This effect inflation is most pronounced in early-published trials within high-impact journals.
- No significant effect inflation was observed for large trials.
Background:
Prestigious journals select for publication studies that are considered most important and informative. We aimed to examine whether high-impact general (HIG) medical journals systematically demonstrate more favourable results for experimental interventions compared with the rest of the literature.
Methods:
We scrutinized systematic reviews of the Cochrane Database (Issue 4, 2009) and meta-analyses published in four general journals (2008-09). Eligible articles included ≥1 binary outcome meta-analysis(es) pertaining to effectiveness with ≥1 clinical trial(s) published in NEJM, JAMA or Lancet. Effect sizes in trials from NEJM, JAMA or Lancet were compared with those from other trials in the same meta-analyses by deriving summary relative odds ratios (sRORs). Additional analyses examined separately early- and late-published trials in HIG journals and journal-specific effects.
Results:
A total of 79 meta-analyses including 1043 clinical trials were analysed. Trials in HIG journals had similar effects to trials in other journals, when there was large-scale evidence, but showed more favourable results for experimental interventions when they were small. When HIG trials had less than 40 events, the sROR was 1.64 [95% confidence interval (95% CI): 1.23-2.18). The difference was most prominent when small early trials published in HIG journals were compared with subsequent trials [sROR 2.68 (95% CI: 1.33-5.38)]. Late-published HIG trials showed no consistent inflation of effects. The patterns did not differ beyond chance between NEJM, JAMA or Lancet.
Conclusions:
Small trials published in the most prestigious journals show more favourable effects for experimental interventions, and this is most prominent for early-published trials in such journals. No effect inflation is seen for large trials.
Related Concept Videos
Clinical Trials
There are four phases in a clinical trial. A phase one...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Clinical Trials: Overview
Hazard Ratio
For example, in a clinical trial evaluating a...
Therapeutic Index
Dose-Response Relationship: Potency and Efficacy