Comparing online and lab methods in a problem-solving experiment
Related Experiment Video
Updated: Jul 4, 2026

Interactive and Visualized Online Experimentation System for Engineering Education and Research
Published on: November 24, 2021
Frédéric Dandurand1, Thomas R Shultz, Kristine H Onishi
1McGill University, Montreal, Quebec, Canada. frederic.dandurand@mail.mcgill.ca
Abstract:
Online experiments have recently become very popular, and--in comparison with traditional lab experiments--they may have several advantages, such as reduced demand characteristics, automation, and generalizability of results to wider populations (Birnbaum, 2004; Reips, 2000, 2002a, 2002b). We replicated Dandurand, Bowen, and Shultz's (2004) lab-based problem-solving experiment as an Internet experiment. Consistent with previous results, we found that participants who watched demonstrations of successful problem-solving sessions or who read instructions outperformed those who were told only that they solved problems correctly or not. Online participants were less accurate than lab participants, but there was no interaction with learning condition. Thus, we conclude that online and Internet results are consistent. Disadvantages included high dropout rate for online participants; however, combining the online experiment with the department subject pool worked well.
Related Concept Videos
Trial and Error and Algorithm
Problem-Solving
Comparing Experimental Results: Student's t-Test
The Scientific Method
Group Design
What is an Experiment?

