Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The timing mega-study: comparing a range of experiment generators, both lab-based and online.

David Bridges1, Alain Pitiot2, Michael R MacAskill3,4

  • 1School of Psychology, University of Nottingham, Nottingham, UK.

Peerj
|October 2, 2020
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Delivering tactile stimuli via mobile browsers: A method for remote multisensory research.

Behavior research methods·2026
Same author

Author Response: Cross-Sectional and Longitudinal Association of Clinical and Neurocognitive Factors With Apathy in Patients With Parkinson Disease.

Neurology·2025
Same author

The New Zealand Parkinson's progression programme.

Journal of the Royal Society of New Zealand·2024
Same author

Apathy and Impulsivity Co-Occur in Huntington's Disease.

Brain and behavior·2024
Same author

Acquired Stuttering in Parkinson's Disease.

Movement disorders clinical practice·2023
Same author

Paramagnetic rims are a promising diagnostic imaging biomarker in multiple sclerosis.

Multiple sclerosis (Houndmills, Basingstoke, England)·2022

This study evaluated the timing precision of behavioral research software. Lab-based experiments showed millisecond precision with packages like PsychoPy, while online studies offered slightly more variability but remained viable for many research applications.

Area of Science:

  • Behavioral Sciences
  • Cognitive Psychology
  • Human-Computer Interaction

Background:

  • Behavioral sciences research relies on software for precise stimulus presentation and response time measurement.
  • Existing timing performance data for popular research software packages is scarce.
  • Accurate timing is crucial for sub-millisecond precision in behavioral experiments.

Purpose of the Study:

  • To comprehensively evaluate the timing precision and accuracy of various behavioral research software packages.
  • To compare performance across different software, operating systems, and online/lab-based environments.
  • To provide empirical data to guide researchers in selecting appropriate software for their needs.

Main Methods:

  • A wide-ranging study measured visual and auditory stimulus timing and response times using a Black Box Toolkit.
Keywords:
ExperimentsMTurkOnline testingOpen-sourcePrecisionReaction timesSoftwareStimuliSub-millisecondTiming

Related Experiment Videos

  • Ten popular software packages (PsychoPy, E-Prime®, NBS Presentation®, Psychophysics Toolbox, OpenSesame, Expyriment, Gorilla, jsPsych, Lab.js, Testable) were tested.
  • Tests were conducted across Windows, macOS, Ubuntu, and various web browsers for online studies, accumulating over 110,000 trials.

    • Main Results:

    • Lab-based experiments: Psychtoolbox, PsychoPy, Presentation, and E-Prime demonstrated the highest timing precision (mean < 1 ms).
    • Operating systems: Ubuntu generally offered slightly better precision than Windows; macOS performed worst for visual stimuli.
    • Online studies: PsychoPy and Gorilla showed the best performance, achieving near-millisecond precision in some configurations; response time precision was generally under 10 ms across most packages.

    Conclusions:

    • Dedicated lab-based software like PsychoPy and E-Prime offer high timing precision crucial for behavioral research.
    • Online research methods, while exhibiting more variability, are suitable for many studies with careful consideration of error sources.
    • Researchers must validate timing performance with their specific stimuli and computer configurations due to observed variability.