评估教学操纵检查的构造有效性,作为对调查的粗心回应的措施
Mark C Ramsey1, Nathan A Bowling1, Preston S Menke2
1University of Central Florida, FL, USA.
Applied psychological measurement
|October 28, 2024
概括
不建议使用指令操纵检查来评估不小心的调查响应. 这些检查显示有效性不佳,与替代方法相比,数据质量没有提高.
科学领域:
- 心理测量 心理测量
- 调查方法 调查方法
- 数据质量保证 数据质量保证
背景情况:
- 在调查中不小心回应是数据完整性的重要问题.
- 指令操纵检查 (IMC) 越来越多地用于检测不小心的反应.
- 作为不小心响应的措施,IMC的构造有效性仍然被低估.
研究的目的:
- 在名义网络中评估指令操纵检查 (IMC) 的构造有效性.
- 为了比较IMC与其他措施的有效性,以检测不小心响应.
- 为IMC在调查研究中的使用提供基于证据的建议.
主要方法:
- 在两个独立样本 (N = 762) 中检查了IMC的构造有效性.
- 评估了与其他不小心应对措施的趋同.
- 评估了参与者对研究内容的认可和对现有措施的增量有效性的预测有效性.
主要成果:
- IMCs表现出不良的趋同与既有措施的疏忽响应.
- IMCs对参与者无法回忆研究内容的预测有效性较弱.
- IMCs没有提供与现有方法相比的增量有效性,并且表现比替代单一评分措施更差.
结论:
- 不建议使用指令操纵检查来评估或选不小心的调查响应.
- 不小心做出反应的替代措施显示出优越或可比的数据质量改进.
- 研究人员应该考虑其他方法来确保调查中的数据完整性.
相关概念视频
Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Systematic Error: Methodological and Sampling Errors
1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
Naturalistic Observations
15.4K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.4K
Statistical Significance
20.1K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.1K
Errors and Mistakes in Surveying
50
Errors and mistakes in surveying refer to inaccuracies in measurements and data recording. The errors are deviations from the actual value caused by human sensory limitations, equipment flaws, or environmental effects. These errors are typically unintentional and can result from the inherent imperfections in the instruments used, atmospheric conditions, or the observer’s inability to perceive exact measurements. On the other hand, mistakes are caused by the surveyor's lack of...
50


