No raw data, no science: another possible source of the reproducibility crisis

Area of Science:

• Scientific research integrity
• Biomedical research
• Data management in science

Background:

• The scientific community faces a reproducibility crisis, where many studies cannot be reliably reproduced.
• Practices like HARKing, p-hacking, and selective reporting are implicated as causes.
• This editorial proposes that a lack of raw data or data fabrication is a significant, under-addressed cause of irreproducibility.

Discussion:

• An analysis of 41 manuscripts requesting raw data revealed that over 97% failed to provide it.
• More than half of these manuscripts were withdrawn upon the request for raw data.
• This high withdrawal and rejection rate suggests that the raw data may not have existed for a substantial portion of these studies.

Key Insights:

• A significant number of scientific publications may lack the foundational raw data necessary for verification.
• The requirement to provide raw data can act as a filter, highlighting potential issues with data integrity.
• Data fabrication and lack of data are critical factors contributing to the scientific reproducibility crisis.

Outlook:

• Journals should mandate the public sharing of raw data in accessible databases or on journal sites.
• Publicizing raw data upon publication is essential for enhancing the reproducibility of scientific findings.
• Increased data transparency will bolster public trust in scientific research and its outcomes.