The Reproducibility Crisis: Shining a Light Where Photo-Induced Process Descriptions Fall Short

Area of Science:

• Scientific reproducibility
• Photochemistry
• Materials science

Background:

• Reproducibility is crucial for scientific advancement, especially in photo-mediated processes.
• The apparent simplicity of photochemistry often hides complex dependencies on experimental conditions.
• Lack of detailed reporting challenges the reliable replication of photo-induced phenomena.

Purpose of the Study:

• To assess the reporting standards for photo-mediated processes in high-impact journals.
• To identify critical missing information required for reproducing photochemical experiments.
• To highlight the impact of under-specified conditions on scientific outcomes.

Main Methods:

• Random selection of 150 articles on photo-mediated processes from top polymer science, chemistry, and physics journals.
• Evaluation of articles for essential reproducibility parameters: exposure conditions, sample geometry, and composition.
• Analysis of reporting completeness for light source (spectrum, irradiance) and sample details.

Main Results:

• Only 8% (polymer science), 4% (chemistry), and 10% (physics) of papers provided sufficient detail for reproduction.
• Significant deficiencies were found in reporting light source characteristics (spectrum and irradiance).
• Just 25% of studies reported adequate light source information.

Conclusions:

• Current reporting practices for photo-mediated processes are inadequate for ensuring reproducibility.
• Under-specification of experimental conditions, particularly light sources, leads to significant variability.
• Improved reporting guidelines are necessary to enhance the reliability of photochemical research.