在互动的在线实验中,mturkers是否勾结在一起?
1Department of Business and Management, Southern Denmark University, Universitetsparken 1, Kolding, 6000, Denmark. raz@sdu.dk.
Behavior research methods
|September 1, 2023
概括
在MTurk等众包平台上,在线实验参与者之间的勾结是罕见的,特别是在典型的设计中. 然而,高回报可能会激励勾结,对交互式在线研究中的数据有效性构成潜在风险.
科学领域:
- 行为经济学是一种行为经济学.
- 实验心理学 实验心理学
- 人与计算机的交互
背景情况:
- 在线实验的内部有效性可能会受到参与者勾结的威胁.
- 众包平台 (例如,亚马逊机械土耳其) 广泛用于参与者招聘.
- 了解勾结的普遍性对于确保在线研究数据质量至关重要.
研究的目的:
- 在交互式在线实验中测量MTurk工人间勾结的普遍性.
- 调查勾结是否受到特定实验设计选择的影响.
- 评估在众包在线实验中对数据有效性的勾结风险.
主要方法:
- 通过MTurk众包平台招募参与者进行了两项实验.
- 操纵了实验设计特征,以测试它们对勾结的影响.
- 分析了参与者的行为,以检测勾结的证据.
主要成果:
- 在模仿典型的交互式在线实验设计的治疗中没有发现勾结的证据.
- 大约3%的MTurk员工参与了勾结,因为他们获得了异常高的回报.
- 勾结在标准的在线实验中不是一个普遍的问题,但在特定的高激励条件下可以发生.
结论:
- 使用MTurk工人的典型交互式在线实验可能不会受到勾结的显著影响.
- 当有强大的激励因素存在时,勾结对在线实验中的数据有效性构成潜在威胁.
- 研究人员应该对勾结风险保持警,特别是在高风险的在线实验设计中.
相关概念视频
Robbers Cave
14.3K
During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...
14.3K
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Ethics in Research
23.1K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.1K
Randomized Experiments
7.0K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
7.0K
Group Polarization
34.3K
Group polarization is the strengthening of an original group attitude following the discussion of views within a group (Teger & Pruitt, 1967). That is, if a group initially favors a viewpoint, after discussion the group consensus is likely a stronger endorsement of the viewpoint. Conversely, if the group was initially opposed to a viewpoint, group discussion would likely lead to stronger opposition.
34.3K


