Related Experiment Video
Updated: Apr 16, 2026

Assessing the Multiple Dimensions of Engagement to Characterize Learning: A Neurophysiological Perspective
Published on: July 1, 2015
A reminder on millisecond timing accuracy and potential replication failure in computer-based psychology experiments:
1The Black Box ToolKit Ltd, PO Box 3802, Sheffield, S25 9AG, UK. r.plant@blackboxtoolkit.com.
Abstract:
There is an ongoing 'replication crisis' across the field of psychology in which researchers, funders, and members of the public are questioning the results of some scientific studies and the validity of the data they are based upon. However, few have considered that a growing proportion of research in modern psychology is conducted using a computer. Could it simply be that the hardware and software, or experiment generator, being used to run the experiment itself be a cause of millisecond timing error and subsequent replication failure? This article serves as a reminder that millisecond timing accuracy in psychology studies remains an important issue and that care needs to be taken to ensure that studies can be replicated on current computer hardware and software.
More Related Videos
07:43Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
Published on: August 4, 2023
16:23Automated, Quantitative Cognitive/Behavioral Screening of Mice: For Genetics, Pharmacology, Animal Cognition and Undergraduate Instruction
Published on: February 26, 2014
Related Concept Videos
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Uncertainty in Measurement: Accuracy and Precision