The logical structure of experiments lays the foundation for a theory of reproducibility
Erkan O Buzbas1, Berna Devezer1,2, Bert Baumgaertner3
1Department of Mathematics and Statistical Science, University of Idaho, Moscow, ID 83844, USA.
Abstract:
The scientific reform movement has proposed openness as a potential remedy to the putative reproducibility or replication crisis. However, the conceptual relationship among openness, replication experiments and results reproducibility has been obscure. We analyse the logical structure of experiments, define the mathematical notion of idealized experiment and use this notion to advance a theory of reproducibility. Idealized experiments clearly delineate the concepts of replication and results reproducibility, and capture key differences with precision, allowing us to study the relationship among them. We show how results reproducibility varies as a function of the elements of an idealized experiment, the true data-generating mechanism, and the closeness of the replication experiment to an original experiment. We clarify how openness of experiments is related to designing informative replication experiments and to obtaining reproducible results. With formal backing and evidence, we argue that the current 'crisis' reflects inadequate attention to a theoretical understanding of results reproducibility.
More Related Videos
09:39An Open-Source, Fully Customizable 5-Choice Serial Reaction Time Task Toolbox for Automated Behavioral Training of Rodents
Published on: January 19, 2022
20:24Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
Published on: January 31, 2014
Related Concept Videos
The Scientific Method
What is an Experiment?
Controls in Experiments
Scientific Laws and Theories
Structuralism
Titchener's approach to structuralism was unique. He...
Experimental Designs
