Magnitude of effects in clinical trials published in high-impact general medical journals

Konstantinos C M Siontis1, Evangelos Evangelou, John P A Ioannidis

  • 1Clinical Trials and Evidence-Based Medicine Unit, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece.

Insights

High-impact journals publish more favorable results for small experimental intervention trials, especially early ones. Large trials show no difference in effect sizes regardless of journal prestige.

Area of Science:

  • Medical research publication bias
  • Clinical trial reporting standards
  • Scientific journal impact

Background:

  • Prestigious journals prioritize important and informative studies.
  • Investigated potential bias in high-impact general (HIG) medical journals regarding experimental intervention results.

Purpose of the Study:

  • To determine if HIG journals systematically publish more favorable results for experimental interventions compared to other literature.
  • To analyze the influence of trial size and publication timing on reported effect sizes in HIG journals.

Main Methods:

  • Systematic review of Cochrane Database and meta-analyses from four general journals (2008-09).
  • Included meta-analyses with ≥1 binary outcome and ≥1 clinical trial.
  • Compared effect sizes from trials in NEJM, JAMA, or Lancet with those in other journals using summary relative odds ratios (sRORs).

Main Results:

  • Analyzed 79 meta-analyses comprising 1043 trials.
  • Trials in HIG journals showed similar effects to others for large-scale evidence.
  • Small trials (<40 events) in HIG journals had more favorable results (sROR 1.64).
  • Early small trials in HIG journals showed the most prominent effect inflation (sROR 2.68).

Conclusions:

  • Small trials in prestigious journals report more favorable experimental intervention effects.
  • This effect inflation is most pronounced in early-published trials within high-impact journals.
  • No significant effect inflation was observed for large trials.
Abstract

Related Concept Videos

Clinical Trials01:16

Clinical Trials

Clinical trials are prospective experimental studies conducted on humans to determine the safety and efficacy of treatments, drugs, diet methods, and medical devices. Using statistics in clinical trials enables researchers to derive reasonable and accurate conclusions from the collected data, allowing them to make wise decisions in uncertain situations. In medical research, statistical methods are crucial for preventing errors and bias.
There are four phases in a clinical trial. A phase one...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Clinical Trials: Overview01:11

Clinical Trials: Overview

Clinical development focuses on how the drug will interact with the human body and encompasses four key phases of clinical trials, each serving a specific purpose in assessing the safety and effectiveness of new drugs. These phases overlap and build upon one another. Phase I involves a small group of healthy volunteers (typically 20-80 individuals) or, in cases where significant toxicity is expected, patients with the targeted disease, such as cancer or AIDS. The volunteers are tested for...
Hazard Ratio01:12

Hazard Ratio

The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial evaluating a...
Therapeutic Index01:13

Therapeutic Index

The therapeutic index of a drug is a key parameter in pharmacology that quantifies the relative safety of a drug by calculating the ratio between the dose that causes toxicity in half the population (50%) to the dose that proves to be effective for half the population (50%). It provides a spectrum of doses for a particular drug ranging from effective to potentially toxic. To illustrate, consider an anticoagulant agent like warfarin. It possesses a narrow window within its therapeutic index to...
Dose-Response Relationship: Potency and Efficacy01:22

Dose-Response Relationship: Potency and Efficacy

The potency of a drug is the measure of its ability to produce a biological response and can be compared by looking at the half-maximum effective concentration or EC50 values of different drugs. A lower EC50 value indicates higher potency of the drug. In the dose–response curve of two antihypertensive drugs, candesartan and irbesartan, a significant difference is observed in their EC50 values. A lower EC50 value for candesartan indicates that it is more potent than irbesartan, as it produces...