Related Experiment Video
Updated: Aug 29, 2025

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan
Published on: June 29, 2018
When should researchers cite study differences in response to a failure to replicate?
David Colaço1, John Bickle2,3, Bradley Walters4,5
1Munich Center for Mathematical Philosophy, LMU Munich, Munich, Germany.
Abstract:
Scientists often respond to failures to replicate by citing differences between the experimental components of an original study and those of its attempted replication. In this paper, we investigate these purported mismatch explanations. We assess a body of failures to replicate in neuroscience studies on spinal cord injury. We argue that a defensible mismatch explanation is one where (1) a mismatch of components is a difference maker for a mismatch of outcomes, and (2) the components are relevantly different in the follow-up study, given the scope of the original study. With this account, we argue that not all differences between studies are meaningful, even if they are difference makers. As our examples show, focusing only on these differences results in disregarding the representativeness of the original experiment's components and the scope of its outcomes, undercutting other epistemic aims, such as translation, in the process.
More Related Videos
08:29An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion
Published on: March 31, 2022
12:12Irrelevant Stimuli and Action Control: Analyzing the Influence of Ignored Stimuli via the Distractor-Response Binding Paradigm
Published on: May 14, 2014
Related Concept Videos
Restarting Stalled Replication Forks
Self-Discrepancy Theory
Regression Toward the Mean
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Milgram's Obedience to Authority
Longitudinal Research