Related Experiment Videos
Enhancing reproducibility: Failures from Reproducibility Initiatives underline core challenges.
Kevin Mullane1, Michael Williams2
1Gladstone Institutes, San Francisco, CA, United States.
Biochemical Pharmacology
|April 12, 2017
Summary
Reproducibility Initiatives (RIs) in biomedical research may hinder scientific self-correction. These initiatives, intended to improve research rigor, can produce questionable outcomes and damage reputations.
Area of Science:
- Biomedical Research
- Scientific Methodology
- Research Integrity
Background:
- Biomedical research faces reproducibility challenges.
- Existing efforts include improved publication standards, detailed methods, and consortia.
- Reproducibility Initiatives (RIs) emerged as a novel approach.
Observation:
- RIs are high-profile, peer-vetted initiatives aiming to replace traditional scientific self-correction.
- Outcomes from RIs have raised questions about their effectiveness, especially when conflicting with independent studies.
- A failed RI cannot provide definitive conclusions and may harm original study authors' reputations.
Findings:
- The RI framework has negatively impacted efforts to enhance research reproducibility.
- RIs can confound the assessment of research finding validity.
- Distinguishing between reproduction (similarity) and replication (exact copy) is crucial but often confused.
Implications:
- The current RI model may not be a suitable replacement for established scientific self-correction processes.
- Further studies are needed to refine approaches to ensuring research reproducibility.
- Clearer definitions and methodologies are required to accurately assess research findings.