Related Experiment Video
Updated: Feb 23, 2026

Assessment and Evaluation of the High Risk Neonate: The NICU Network Neurobehavioral Scale
Published on: August 25, 2014
Do trials reduce uncertainty? Assessing impact through cumulative meta-analysis of neonatal RCTs.
S C Hay1,2, H Kirpalani3, C Viner4
1Department of Neonatology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
The latest randomized controlled trials (RCTs) often fail to significantly impact systematic reviews. New RCTs rarely change effect estimates or statistical significance, suggesting a need to prioritize under-researched topics.
Area of Science:
- Medical research methodology
- Evidence-based medicine
- Clinical trial analysis
Background:
- Systematic reviews (SRs) synthesize evidence from randomized controlled trials (RCTs).
- The incremental impact of new RCTs on existing SRs is not well quantified.
- Cochrane Neonatal Reviews provide a relevant dataset for evaluating this impact.
Purpose of the Study:
- To assess the impact of the latest RCT on systematic reviews in Cochrane Neonatal Reviews.
- To determine factors influencing the impact of new RCTs on meta-analytic estimates.
Main Methods:
- Selected meta-analyses from Cochrane Neonatal Reviews based on the latest RCT.
- Employed cumulative meta-analysis to track estimate changes as new trials were added.
- Used multivariable logistic regression to identify predictors of study impact.
Main Results:
- A majority of latest RCTs did not substantially narrow confidence intervals (CIs) or change effect estimates.
- Only a small percentage of RCTs altered the directionality or statistical significance of primary outcomes.
- The ability of an RCT to narrow the CI was inversely related to the number of prior RCTs.
Conclusions:
- The latest RCTs frequently have a limited impact on the overall evidence synthesis in SRs.
- Consideration should be given to prioritizing under-researched topics for future RCTs.
- Formal assessment of optimal information size is recommended for power calculations in new RCTs.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Regression Toward the Mean
Clinical Trials
There are four phases in a clinical trial. A phase one...
Clinical Trials: Overview
Teratogenicity
Drug Dosing: Infants and Children

