Transparency and Reproducibility of Meta-Analyses in Psychology: A Meta-Review

Area of Science:

• Psychological research methodology
• Research synthesis
• Meta-analysis

Background:

• Systematic reviews and meta-analyses rely on transparent primary research reporting.
• High transparency and reproducibility are expected from meta-analysts.
• This assumption requires empirical testing within psychological sciences.

Purpose of the Study:

• To assess the transparency and reproducibility of meta-analyses in psychology.
• To identify specific reporting practices and areas for improvement.

Main Methods:

• Conducted a meta-review of 150 meta-analyses published in *Psychological Bulletin*.
• Extracted data on transparent and reproducible reporting practices.
• Analyzed reporting trends over three decades.

Main Results:

• Authors reported an average of 55% of assessed transparency criteria.
• Transparent reporting practices showed a statistically significant increase over time (b = 1.09, p < .001).
• Commonly reported: eligibility criteria, effect-size, synthesis techniques. Lacking: search results, screening/extraction procedures, individual study data, statistical code.

Conclusions:

• Psychological meta-analyses exhibit moderate transparency, with significant room for improvement in reproducibility.
• Key elements for analytical replication, such as individual study data and statistical code, are frequently omitted.
• The field of psychology and research synthesis should mandate comprehensive transparent and reproducible reporting standards for meta-analyses.