Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Reliability and Validity01:29

Reliability and Validity

13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Surveys02:16

Surveys

16.6K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
16.6K
Naturalistic Observations02:30

Naturalistic Observations

17.0K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
17.0K
Systematic Error: Methodological and Sampling Errors01:15

Systematic Error: Methodological and Sampling Errors

8.6K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
8.6K
Longitudinal Research02:20

Longitudinal Research

13.0K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
13.0K
Regression Toward the Mean01:52

Regression Toward the Mean

6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Assessing Conspiracist Ideation Reliably, Validly, and Efficiently: A Psychometric Comparison of Five Short-Form Measures.

Assessment·2025
Same author

Validating the IDRIS and IDRIA: Two infrequency/frequency scales for detecting careless and insufficient effort survey responders.

Behavior research methods·2024
Same author

Moral Foundations Partially Explain the Associations of Machiavellianism, Grandiose Narcissism, and Psychopathy With Homonegativity and Transnegativity.

Journal of homosexuality·2022
Same author

Antecedents and consequences of COVID-19 conspiracy beliefs: A systematic review.

Social science & medicine (1982)·2022
Same author

Animal House: The Dark Tetrad traits and membership in sororities and fraternities.

Acta psychologica·2021

相关实验视频

Updated: Jan 11, 2026

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents
06:15

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

Published on: July 10, 2017

13.4K

为什么你不应该相信在MTurk上收集的数据

Cameron S Kay1,2

  • 1Environmental Social Sciences Department, Stanford University, 473 Via Ortega, Stanford, CA, 94301, USA. cameronstuartkay@gmail.com.

Behavior research methods
|November 10, 2025
PubMed
概括

亚马逊机械土耳其 (MTurk) 的数据质量不可靠. 相互矛盾的调查项目在MTurk上显示出正相关性,与其他平台不同,表明数据收集不值得信赖.

科学领域:

  • 心理学是一门科学.
  • 数据科学是数据科学.
  • 人与计算机的互动.

背景情况:

  • 之前的研究表明亚马逊机械土耳其 (MTurk) 的数据质量问题.
  • 先进的方法已经证实了这些数据完整性问题.
  • 需要可访问的演示来说明问题的程度.

研究的目的:

  • 为MTurk.提供数据质量问题的明确和可访问的演示.
  • 为了比较MTurk,Connect和Prolific平台的数据质量.
  • 调查语义反义词项对对的可靠性,以评估数据完整性.

主要方法:

  • 管理了27个语义反义词项目对,评估矛盾的内容.
  • 从Connect (N=100),Prolific (N=100) 和MTurk (N=1000) 的样本收集的数据.
  • 分析了不同平台上的项目对相关性.

主要成果:

  • 超过96%的项目对在MTurk上具有积极的相关性,与Connect和Prolific的负相关性形成鲜明对比.
  • 使用注意力检查的数据选没有解决这个问题.
  • 招募高生产率或高声誉的MTurk参与者并没有提高数据可靠性.
关键词:
亚马逊的机械土耳其人不小心的回应不小心的回应.数据质量数据质量数据质量不有效的回复者正在回复.心理测量 心理测量 心理测量调查设计和方法研究.

更多相关视频

Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.4K
Revised and Neuroimaging-Compatible Versions of the Dual Task Screen
07:52

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Published on: October 5, 2020

3.9K

相关实验视频

Last Updated: Jan 11, 2026

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents
06:15

A Modified Trier Social Stress Test for Vulnerable Mexican American Adolescents

Published on: July 10, 2017

13.4K
Methods to Test Visual Attention Online
09:44

Methods to Test Visual Attention Online

Published on: February 19, 2015

12.4K
Revised and Neuroimaging-Compatible Versions of the Dual Task Screen
07:52

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Published on: October 5, 2020

3.9K

结论:

  • 通过MTurk收集的数据显示了重要的质量和可靠性问题.
  • 标准的数据清理和参与者选择方法不足以确保MTurk数据完整性.
  • 调查结果强烈表明,MTurk数据不能用于研究目的.