Related Experiment Video
Updated: Mar 10, 2026

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
Published on: November 27, 2019
Including non-public data and studies in systematic reviews and systematic maps
Neal R Haddaway1, Alexandra M Collins2, Deborah Coughlin3
1MISTRA EviEM, Stockholm Environment Institute, Box 24218, 10451 Stockholm, Sweden.
Including non-public studies in systematic reviews enhances evidence comprehensiveness and mitigates publication bias. Reviewers must weigh the benefits of inclusion against potential risks and maintain transparency in methods.
Area of Science:
- Evidence-based practice
- Systematic review methodology
- Research integrity
Background:
- Systematic reviews aim for comprehensive evidence synthesis.
- Publication bias and delays can limit the evidence base.
- Non-public studies represent a potential source of additional data.
Purpose of the Study:
- To explore the forms and implications of including non-public studies in systematic reviews and maps.
- To provide guidance for reviewers dealing with non-public data.
- To enhance the comprehensiveness of systematic reviews.
Main Methods:
- Consideration of reasons for studies being non-public (e.g., ongoing publication, restrictions, negative results).
- Analysis of the advantages (comprehensiveness) and disadvantages (bias) of including non-public studies.
- Development of tentative suggestions for reviewers.
Main Results:
- Non-public studies can stem from various factors, including publication delays or negative findings.
- Inclusion of non-public studies can improve review comprehensiveness and reduce bias.
- Careful consideration of risks versus benefits is crucial for reviewers.
Conclusions:
- Including non-public studies offers a valuable opportunity to strengthen systematic reviews.
- Transparency in methods and careful risk assessment are essential when incorporating non-public data.
- Reviewers should judiciously balance comprehensiveness with potential biases.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Statistical Methods for Analyzing Epidemiological Data
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
Archival Research
Study Design in Statistics
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
