机器人还是没有? 在远程进行数字研究时检测和管理参与者欺骗:随机对照试验的案例研究
Gemma Loebenberg1, Melissa Oldham1, Jamie Brown1
1UCL Tobacco and Alcohol Research Group, University College London, London, United Kingdom.
Journal of medical Internet research
|September 14, 2023
概括
远程研究试验面临自动化机器人和手动欺诈的欺骗风险. 在一项数字健康研究中,实施CAPTCHA,注意力检查和电话验证显著减少了这些问题.
科学领域:
- 数字健康研究数字健康研究
- 行为科学是一种行为科学.
- 临床试验方法论 临床试验方法论
背景情况:
- 远程数字干预为大量参与者提供了具有成本效益的招聘.
- 然而,依赖于自我报告的远程研究容易受到自动化机器人和参与者欺骗的影响.
研究的目的:
- 为了检查参与者欺骗在一个远程酒精减酒应用程序试验.
- 突出金融补偿对欺诈行为的影响.
- 强调强有力的数据管理的必要性,以检测和减轻欺骗.
主要方法:
- 一项随机对照试验 (n=5602) 评估了"少喝酒"减酒应用程序.
- 招聘发生在线从2020年7月到2022年3月.
- 欺诈检测涉及地址/电话验证以识别机器人和手动欺诈.
主要成果:
- 最初,75.6%的早期入学者被确定为机器人;CAPTCHA的实施消除了这一点.
- 5%的非机器人参与者被确定为手动欺骗.
- 在实施注意力检查,不重视经济补偿和要求电话验证后,欺骗率下降.
结论:
- 严格的数据管理对于识别远程试验中的自动化和手动欺骗至关重要.
- 缓解策略包括CAPTCHA,注意力检查,电话验证和对补偿的谨慎广告.
相关概念视频
Naturalistic Observations
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Ethics in Research
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
Blinding
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
Understanding Deception
Deception is a pervasive aspect of human communication. Empirical studies have shown that most individuals engage in some form of deceit on a daily basis, with approximately 20% of social exchanges involving deceptive elements. Lying follows a developmental trajectory, peaking during adolescence and declining with age, possibly due to the maturation of cognitive control and social accountability.Cognitive and Social Factors in Deception DetectionDespite its prevalence, accurately detecting...


