Related Experiment Video
Updated: Apr 20, 2026

09:44
Methods to Test Visual Attention Online
Published on: February 19, 2015
12.7K
QRTEngine: An easy solution for running online reaction time experiments using Qualtrics
Jonathan S Barnhoorn1,2,3, Erwin Haasnoot1,4, Bruno R Bocanegra1,5
1Institute of Psychology, Leiden University, Wassenaarseweg 52, Leiden, 2333, AK, The Netherlands.
Behavior Research Methods
|November 20, 2014
Summary
Researchers can now easily conduct online reaction time experiments using the Qualtrics Reaction Time Engine (QRTEngine). This tool simplifies complex setups, enabling accurate behavioral research with minimal coding skills.
Area of Science:
- Cognitive Science
- Psychological Research
- Behavioral Science
Background:
- Online behavioral research is increasingly popular in psychological and cognitive science.
- Existing methods for online reaction time experiments are often complex and require advanced technical skills.
Purpose of the Study:
- Introduce the Qualtrics Reaction Time Engine (QRTEngine), an open-source JavaScript tool.
- Demonstrate the ease of use and accuracy of QRTEngine for online reaction time experiments.
- Validate QRTEngine's capability to reproduce classic behavioral effects.
Main Methods:
- Developed an open-source JavaScript engine (QRTEngine) embeddable in Qualtrics.
- Investigated timing accuracy under varying processor loads using external chronometry.
- Tested QRTEngine with Stroop, attentional blink, and masked-priming tasks.
Main Results:
- QRTEngine allows easy development of browser-based reaction time experiments with accurate timing.
- Timing accuracy was validated under different processor loads.
- Classic behavioral effects were successfully reproduced in three distinct reaction time paradigms.
Conclusions:
- QRTEngine is a valuable tool for conducting online behavioral research.
- The engine simplifies the creation of accurate online reaction time experiments.
- QRTEngine is suitable for research requiring precise stimulus presentation times.

