Extra-laboratorial usability tests: An empirical comparison of remote and classical field testing with lab testing
Related Experiment Video
Updated: Feb 2, 2026

Experimental Protocol for Using Drosophila As an Invertebrate Model System for Toxicity Testing in the Laboratory
Published on: July 10, 2018
Juergen Sauer1, Andreas Sonderegger1, Klaus Heyden1
1Department of Psychology, University of Fribourg, Fribourg, Switzerland.
Abstract:
The present article examined the effects of using different extra-laboratorial testing procedures in usability testing. Three experiments were conducted using different artefacts (website, computer-simulated mobile phone, fully operational smartphone) to compare different methodological approaches in field testing (synchronous and asynchronous remote testing, classical field testing) to lab-based testing under different operational conditions (dual task demands, poor product usability). Typical outcome variables of usability testing were measured, including task completion time, click rate, perceived usability and workload. Overall, the results showed no differences between field and lab-based testing under favourable operational conditions. However, under difficult operational conditions (i.e. dual task demands, poor product usability) differences between field and lab-based testing emerged (corresponding to small and medium effect sizes). The findings showed a complex pattern of effects, suggesting that there was no general advantage of one testing procedure over another.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Testes: Histology
The spermatogenic cells, responsible for producing sperm, are...
Complementation Tests
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
Significance Testing: Overview
Testes: Gross Anatomy
Each testis is surrounded by the tunica albuginea, a dense connective tissue layer that provides structural support and protection. This layer is covered by an outer serous membrane called the tunica vaginalis, which helps reduce friction...
Testing Water Quality

