在亚马逊的机械土耳其人和伊普索的知识之间比较健康调查数据成本和质量Panel:观察性研究
Patricia M Herman1, Mary E Slaughter1, Nabeel Qureshi1
1RAND, Santa Monica, CA, United States.
Journal of medical Internet research
|November 29, 2024
概括
在比较调查平台时,亚马逊机械土耳其 (MTurk) 提供了成本节省,但通常比基于概率的KnowledgePanel更低的数据质量,特别是在教育变量方面.
科学领域:
- 医疗保健服务研究 医疗服务研究
- 调查方法 调查方法
- 数据科学数据科学数据科学
背景情况:
- 基于网络的调查数据收集提供了多种选择,包括基于概率的面板和更便宜的便利面板.
- 方便面板,像亚马逊的机械土耳其人 (MTurk),在受访者代表性和动机上有所不同.
- 在选择面板类型时,研究人员必须权衡数据质量与成本节约.
研究的目的:
- 为了比较MTurk和KnowledgePanel上进行同等调查的相对成本和数据质量.
- 评估质量保证步骤对MTurk数据的影响.
- 评估来自两个平台的数据的代表性和心理特征.
主要方法:
- 对MTurk和KnowledgePanel参与者进行了同等的调查.
- 对MTurk数据应用了质量保证步骤;对于KnowledgePanel,使用了标准协议.
- 数据质量被评估使用如一致性,可靠性,代表性和相关性等指标,包括使用假条件来识别诚实的受访者.
主要成果:
- 随着预先选,MTurk数据质量有所改善,但总体上仍然低于KnowledgePanel.
- 权重的MTurk人口统计估计与国家平均水平相匹配,而KnowledgePanel估计甚至在加权之前更接近.
- 患者报告结果测量信息系统 (PROMIS) 测量和人口统计数据之间的相关性有显著差异,特别是MTurk上的教育水平.
结论:
- MTurk数据质量往往低于KnowledgePanel,但成本效益可能超过某些研究应用的质量差异.
- 在使用MTurk进行教育水平是关键变量的研究时,建议谨慎使用.
- 该研究强调了在线调查研究中成本和数据质量之间的权衡.
关键词:
在亚马逊亚马逊亚马逊亚马逊亚马逊亚马逊知识面板知识面板在MTurk上使用MTurk.机械土耳其人 机械土耳其人背部疼痛 疼痛 背部疼痛方便面板是一个方便面板.方便样本是为了方便的样本.数据收集数据收集数据收集数据质量数据质量数据质量虚假陈述 虚假陈述 虚假陈述概率面板是一个概率面板.权衡权衡权衡权衡权衡权衡权衡更多相关视频
11:21Methodology for Establishing a Community-Wide Life Laboratory for Capturing Unobtrusive and Continuous Remote Activity and Health Data
Published on: July 27, 2018
8.2K
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.3K
相关概念视频
Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Observational Studies
8.2K
Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
8.2K
Comparing the Survival Analysis of Two or More Groups
152
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
152
Data Collection by Observations
11.7K
Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
11.7K
Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
