Related Experiment Video
Updated: Jun 22, 2026

An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion
Published on: March 31, 2022
Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an
Tom E Hardwicke1,2, Manuel Bohn3, Kyle MacDonald4
1Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
Abstract:
For any scientific report, repeating the original analyses upon the original data should yield the original outcomes. We evaluated analytic reproducibility in 25 Psychological Science articles awarded open data badges between 2014 and 2015. Initially, 16 (64%, 95% confidence interval [43,81]) articles contained at least one 'major numerical discrepancy' (>10% difference) prompting us to request input from original authors. Ultimately, target values were reproducible without author involvement for 9 (36% [20,59]) articles; reproducible with author involvement for 6 (24% [8,47]) articles; not fully reproducible with no substantive author response for 3 (12% [0,35]) articles; and not fully reproducible despite author involvement for 7 (28% [12,51]) articles. Overall, 37 major numerical discrepancies remained out of 789 checked values (5% [3,6]), but original conclusions did not appear affected. Non-reproducibility was primarily caused by unclear reporting of analytic procedures. These results highlight that open data alone is not sufficient to ensure analytic reproducibility.
Related Concept Videos
Naturalistic Observations
Ethics in Research
Reliability and Validity
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Psychology as a Science
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
Scientific Nature of Social Psychology

