Related Experiment Video
Updated: Aug 11, 2025
08:35
Interactive and Visualized Online Experimentation System for Engineering Education and Research
Published on: November 24, 2021
2.5K
Conducting interactive experiments on Toloka.
1University of Bonn, Institute for Applied Microeconomics, Adenauerallee 24-42, Bonn, 53113, Germany.
Journal of Behavioral and Experimental Finance
|February 6, 2023
Summary
Online behavioral experiments can now include real-time interactions. The Toloka platform offers a viable solution for researchers seeking to conduct complex studies, overcoming limitations of other crowdsourcing tools.
Area of Science:
- Behavioral economics
- Sociology
- Political science
Background:
- Online behavioral experiments gained traction before the COVID-19 pandemic.
- Pandemic lockdowns made online studies essential for researchers.
- Existing platforms like mTurk faced data quality issues due to overuse.
Purpose of the Study:
- To explore the feasibility of conducting multi-round interactive behavioral experiments online.
- To address limitations in real-time participant interaction and group stability in online studies.
- To evaluate the Toloka crowdsourcing platform as a tool for experimental research.
Main Methods:
- Conducted multi-round interactive experiments using the Toloka crowdsourcing platform.
- Leveraged Toloka's application programming interface (API) for experimental design.
- Recruited participants from Toloka's large online population.
Main Results:
- Successfully executed several multi-round interactive experiments on Toloka.
- Demonstrated Toloka's capability to facilitate real-time participant interactions.
- Observed lower participant exposure to sociological and behavioral studies on Toloka compared to other platforms.
Conclusions:
- Toloka is a promising platform for behavioral researchers needing real-time interaction capabilities.
- The platform overcomes dropout and group stability issues common in other online study formats.
- Toloka offers a valuable alternative for complex online behavioral experiments.
Related Concept Videos
01:13Data Collection by Experiments
24.6K
Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method of data collection that involves the manipulation of the samples by applying some form of treatment prior to data collection. It refers to manipulating one variable to determine its changes on another variable. The sample subjected to treatment is known as “experimental units.”
An example of the experimental method is a public...
An example of the experimental method is a public...
24.6K
01:13Controls in Experiments
7.9K
When conducting an experiment, it is crucial to have control to reduce bias and accurately measure the dependent variables. It also marks the results more reliable. Controls are elements in an experiment that have the same characteristics as the treatment groups but are not affected by the independent variable. By sorting these data into control and experimental conditions, the relationship between the dependent and independent variables can be drawn. A randomized experiment always includes a...
7.9K
01:16Experimental Designs
11.6K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
11.6K
01:12What is an Experiment?
11.9K
An experiment is a planned activity carried out under controlled conditions. The purpose of an experiment is to investigate the relationship between two variables. When one variable causes change in another, we call the first variable the explanatory or independent variable. The affected variable is called the response or dependent variable. In a randomized experiment, the researcher manipulates values of the explanatory variable and measures the resulting changes in the response variable. The...
11.9K
01:16Crossover Experiments
2.9K
Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
2.9K
01:13Randomized Experiments
7.1K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.1K