传统和重新采样的个人可靠性在检测不小心响应时的比较
Philippe Goldammer1, Peter Lucas Stöckli2, Hubert Annen2
1Military Academy at ETH Zurich, Birmensdorf, Switzerland. philippe.goldammer@milak.ethz.ch.
Behavior research methods
|September 16, 2024
概括
与传统的个人可靠性 (PR) 相比,重新采样的个人可靠性 (RPR) 显著改善了检测不小心的调查答案. 使用25个复制样本来计算RPR足以提高选问卷数据的准确性.
科学领域:
- 心理测量 心理测量
- 调查方法 调查方法
- 数据质量保证 数据质量保证
背景情况:
- 确保调查数据的可信性需要检测不小心的响应.
- 个人可靠性 (PR) 是识别这些反应的强有力的指数.
- 建议重新采样个人可靠性 (RPR) 版本,以减轻PR计算中固有的随机错误.
研究的目的:
- 为了比较传统的个人可靠性 (PR) 和重新采样的个人可靠性 (RPR) 在检测不小心响应方面的性能.
- 确定在哪些条件下,RPR比PR在检测准确度方面提供了最显著的收益.
- 通过模拟和现实世界调查数据验证RPR的有效性.
主要方法:
- 进行了一项模拟研究,以评估PR和RPR的性能与已知的疏忽响应模式相比.
- 一项真实数据研究分析了PR和RPR在识别人类产生的疏忽反应方面的有效性.
- 在不同数量的复样中评估了RPR的性能,用于计算.
主要成果:
- 在模拟和真实数据研究中,与PR相比,RPR作为不小心反应指标的表现明显优于PR.
- 该研究发现,使用25个重复样本进行RPR计算足够地捕捉了比传统PR的性能优势.
- 与PR相比,RPR被证明不那么容易受到与特定半尺度配对相关的随机错误的影响.
结论:
- 建议重新采样个人可靠性 (RPR) 作为对常规个人可靠性 (PR) 的优越替代方案,用于选问卷数据.
- RPR方法在检测疏忽响应方面提供了更高的准确性,从而提高了调查结果的整体可信度.
- 至少25个复样是足够的,以实现RPR相对于PR的性能增长.
相关概念视频
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
Systematic Error: Methodological and Sampling Errors
1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
Statistical Analysis: Overview
6.2K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.2K
Convenience Sampling Method
8.8K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population.
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
8.8K
The Representativeness Heuristic
15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K


