Transparency and reproducibility in the Adolescent Brain Cognitive Development (ABCD) study

Area of Science:

• Neuroscience
• Developmental Psychology
• Data Science

Background:

• Scientific transparency is vital for trust, but poor data practices can undermine findings.
• The Adolescent Brain Cognitive Development (ABCD) Study generates large datasets crucial for understanding brain development.
• Ensuring transparency and reproducibility in research using ABCD Study data is essential.

Purpose of the Study:

• To assess current data use and reporting practices in publications utilizing ABCD Study data.
• To identify areas for improvement in transparency and reproducibility.
• To provide actionable recommendations for future research.

Main Methods:

• Systematic review of articles published from 2017-2023 using ABCD Study data.
• Data extraction using over 30 items focusing on data use and reporting.
• Calculation of a Level of Completeness (LOC) score to quantify transparency.

Main Results:

• 549 articles were analyzed; analytic scripts shared in 30% and missing data details in 38%.
• High LOC scores correlated with better reporting of missing data.
• Lower LOC scores were significantly associated with lower journal impact factors.

Conclusions:

• Significant opportunities exist to enhance data transparency and reproducibility in ABCD Study research.
• Adopting recommended practices can improve the rigor and impact of future studies.
• Clearer reporting of data handling, exclusions, and analytic methods is needed.