Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis

Area of Science:

• Scientific research integrity
• Academic publishing reform

Background:

• The
• reproducibility crisis
• is a complex issue encompassing reagent purity, code accessibility, and academic incentives.
• Previous attempts to define reproducibility analytically have not fully structured these discussions.

Purpose of the Study:

• To empirically investigate the variation in discussions surrounding the reproducibility crisis.
• To identify the core themes and distinct clusters within reproducibility discourse.

Main Methods:

• A novel mixed-methods approach combining grounded theory and correspondence analysis.
• Analysis of a variety of authors' narratives on the reproducibility crisis.

Main Results:

• A clear thematic core in reproducibility discussions: scientific incentive structures, methods/data transparency, and publishing reform.
• Identification of three distinct clusters: reagents, statistical methods, and natural world heterogeneity.
• No significant differences in how scientists and journalists discuss the crisis.

Conclusions:

• Qualitative methods effectively delineate the scope and features of reproducibility discourse.
• Distinct vocabularies and groups within the discourse require targeted engagement for reform.