Related Experiment Video
Updated: Mar 30, 2026
08:05
Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
8.2K
Reaction time effects in lab- versus Web-based research: Experimental evidence.
1Cognitive Psychology Laboratory, Department of Psychology, University of Koblenz-Landau, Fortstraße 7, 76829, Landau, Germany. hilbig@uni-landau.de.
Behavior Research Methods
|November 7, 2015
Summary
Web-based research is as reliable as lab research for measuring reaction times. This study found no significant differences, even showing larger effects online, debunking skepticism about online data collection accuracy.
Area of Science:
- Cognitive Psychology
- Psycholinguistics
- Human-Computer Interaction
Background:
- Web-based research is increasingly common but faces skepticism regarding reaction time (RT) data.
- Concerns include increased variability, software limitations, and lack of direct comparisons between online and lab settings.
Purpose of the Study:
- To critically evaluate the validity of Web-based reaction time data collection.
- To compare RT data collected in a lab using standard software, in a lab using browser-based software, and online using browser-based software.
Main Methods:
- A lexical decision task was employed.
- Participants were randomly assigned to three conditions: lab (standard software), lab (browser-based), and online (browser-based).
- Reaction times were measured and analyzed, focusing on the word frequency effect.
Main Results:
- The word frequency effect was robust and comparable across all three conditions.
- No inferiority was found for Web- or browser-based data collection.
- Browser-based conditions (lab and online) showed a trend towards larger effects than standard lab software.
- No significant differences were observed between lab and online browser-based data collection.
Conclusions:
- Web-based reaction time data collection is a valid and reliable method.
- The study refutes the preconception that subtle reaction time effects are undetectable online.
- Online data collection does not introduce substantial technical or situational variation impacting results.
