Related Experiment Video
Updated: May 9, 2026
Measuring and Manipulating Functionally Specific Neural Pathways in the Human Motor System with Transcranial Magnetic Stimulation
Published on: February 23, 2020
Better living through transparency: improving the reproducibility of fMRI results through comprehensive methods
1Department of Psychology, University of Michigan, 530 Church Street, Ann Arbor, MI, 48109, USA, jm.carp@gmail.com.
Abstract:
Recent studies suggest that a greater proportion of published scientific findings than expected cannot be replicated. The field of functional neuroimaging research is no exception to this trend, with estimates of false positive results ranging from 10 % to 40 %. While false positive results in neuroimaging studies stem from a variety of causes, incomplete methodological reporting is perhaps the most obvious: Most published reports of neuroimaging studies provide ambiguous or incomplete descriptions of their methods and results. If neuroimaging researchers do not report methods and results in adequate detail, independent scientists can neither check their work for errors nor accurately replicate their efforts. Thus, I argue that comprehensive methods reporting is essential for reproducible research. I recommend three strategies for improving transparency and reproducibility in neuroimaging research: improving natural language descriptions of research protocols; sharing source code for data collection and analysis; and sharing formal, machine-readable representations of methods and results. Last, I discuss the technological and cultural barriers to implementing these recommendations and suggest steps toward overcoming those barriers.
Insights
Reproducibility in scientific research is declining, particularly in functional neuroimaging. Enhancing methods reporting through detailed descriptions, shared code, and machine-readable data is crucial for reliable scientific findings.
Area of Science:
- Neuroscience
- Scientific Methodology
Background:
- Growing concern over irreproducibility in scientific findings.
- Functional neuroimaging studies exhibit high rates of false positives (10-40%).
- Incomplete methodological reporting is a key contributor to poor reproducibility.
Purpose of the Study:
- To highlight the critical need for comprehensive methods reporting in neuroimaging research.
- To advocate for increased transparency and reproducibility in scientific studies.
Main Methods:
- Analysis of current trends in scientific reproducibility.
- Identification of factors contributing to irreproducibility in neuroimaging.
- Proposal of strategies to enhance methods reporting.
Main Results:
- Incomplete reporting of methods and results hinders error checking and replication.
- Lack of detailed information prevents independent verification of neuroimaging findings.
Conclusions:
- Comprehensive methods reporting is essential for reproducible research.
- Recommendations include improved natural language descriptions, source code sharing, and machine-readable data formats.
- Addressing technological and cultural barriers is necessary for implementation.
