Related Experiment Video
Updated: Apr 22, 2026

A Clinical Trial Assessing the Safety, Efficacy, and Delivery of Olive-Oil-Based Three-Chamber Bags for Parenteral Nutrition
Published on: September 20, 2019
Unpublished trials affected evidence synthesis substantially when estimating medication harms in children
Zuhaer Yisha1, Zhaohu Fan2, Luis Furuya-Kanamori3
1Department of Epidemiology and Biostatistics, School of Public Health, Peking University, Beijing, China; Key Laboratory of Epidemiology of Major Diseases (Peking University), Ministry of Education, Beijing, China.
Background And Objectives:
To investigate the impact of unpublished trials on the pooled estimates for medication harms.
Methods:
Cochrane reviews published up to February 2023 that evaluated drug interventions and adverse events in children were collected, along with the metadata from rm5 files. The prevalence of unpublished trials among the meta-analyses was summarized, and then the meta-analytic effects were replicated by removing these trials. Association between percentage of unpublished trials and the impact were examined via logistic regression, measured by odds ratio (OR) and its 95% confidence interval.
Results:
Among 740 eligible meta-analyses, 14.9% included unpublished trials. Excluding these trials changed effect direction in 26.4% of meta-analyses, statistical significance in 28.2%, and magnitude by >50% in 8.2%. Subgroup analyses showed that the impact was more pronounced in smaller meta-analyses, regardless of the effect direction (less than five studies vs those with 10 or more studies: 42.9% vs 4.8%) or the statistical significance (46.0% vs 4.8%). Higher percentage of unpublished trials showed larger impact, regardless of the direction or significance (eg, 50% vs 20%, significance: odds ratio = 11.5, 95% confidence interval: 4.7-28.6, P< .001).
Conclusion:
Even a small number of eligible unpublished trials can substantially alter pooled effect estimates, particularly in drug safety research. Systematic reviews should include a comprehensive search for unpublished harms data from trials.
Insights
Unpublished trials significantly impact medication harm estimates. Even a few unpublished studies can alter results, especially in smaller drug safety reviews. Comprehensive searches for all trial data are crucial.
Area of Science:
- Pharmacovigilance
- Clinical Trial Methodology
- Biostatistics
Background:
- The completeness of evidence in systematic reviews is critical for accurate medication safety assessments.
- Unpublished studies may introduce bias into pooled estimates of drug harms.
Purpose of the Study:
- To investigate the influence of unpublished trials on pooled estimates of medication harms in pediatric drug safety research.
- To quantify the impact of excluding unpublished trials on meta-analytic results.
Main Methods:
- Systematic search and data extraction from Cochrane reviews (up to Feb 2023) on pediatric drug interventions and adverse events.
- Replication of meta-analytic effects by excluding unpublished trials and examining associations with their prevalence.
- Logistic regression analysis using odds ratios (OR) and 95% confidence intervals (CI) to assess impact.
Main Results:
- 14.9% of 740 eligible meta-analyses included unpublished trials.
- Exclusion of unpublished trials altered effect direction (26.4%), statistical significance (28.2%), and magnitude (>50% in 8.2%).
- Impact was greater in smaller meta-analyses and increased with a higher percentage of unpublished trials (OR=11.5 for significance).
Conclusions:
- A small number of unpublished trials can substantially change pooled effect estimates for medication harms.
- Findings underscore the importance of including unpublished data in systematic reviews for robust drug safety evaluations.
- Systematic reviews must prioritize comprehensive searches for unpublished harms data.
More Related Videos
04:34Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia
Published on: February 17, 2023
10:02Event Related Potentials ERPs and other EEG Based Methods for Extracting Biomarkers of Brain Dysfunction: Examples from Pediatric Attention Deficit/Hyperactivity Disorder ADHD
Published on: March 12, 2020
Related Concept Videos
Pharmacokinetics in Pediatric Patients: Drug Metabolism
Pharmacovigilance
This process, termed pharmacovigilance, aims to detect, evaluate, and minimize harmful effects related to medication use. The data collection for pharmacovigilance depends on spontaneous reporting systems, where healthcare professionals or patients voluntarily report suspected ADRs.
In some cases, there...
Clinical Trials: Overview
Clinical Trials
There are four phases in a clinical trial. A phase one...
Hazard Ratio
For example, in a clinical trial...
Drug Regulation