通过开放式调查响应分析来评估构造可靠性
Katherine E Koralesky1, Marina A G von Keyserlingk1, Daniel M Weary1
1Animal Welfare Program, Faculty of Land and Food Systems, The University of British Columbia, Vancouver, British Columbia, Canada.
PloS one
|April 1, 2025
概括
检测在线调查答复中的复制文本可以识别不注意的参与者. 使用对定性答案的原创性检查有助于确保数据质量和参与者的参与.
科学领域:
- 心理学 心理学 心理学
- 调查方法 调查方法
- 数据质量数据质量
背景情况:
- 在线调查通常使用定量注意力检查.
- 定性反应也可以表明参与者没有注意力.
- 评估响应的原创性提供了一个新的选方法.
研究的目的:
- 评估使用对开放式调查答案的原创性检查以识别不注意的参与者的有效性.
- 为了确定提供复制回复的参与者是否表现出较低的数据质量.
主要方法:
- 使用TurnitinTM软件来评估四个混合方法在线调查中开放式响应的原创性.
- 分析了3,771名参与者的数据,检查了指标可靠性和内部一致性可靠性.
- 在复制回复和原始回复的参与者之间比较可靠性指标.
主要成果:
- 18-35%的参与者提供了被标记为原创性问题 (复制文本) 的回复.
- 复制回复的参与者表现出较低的指标可靠性和内部一致性.
- 原始响应与更高的尺度一致性相关,表明参与者注意力更大.
结论:
- 对定性调查答案的原创性检查是选不注意的参与者的可行方法.
- 这种方法可以提高在线调查数据的整体质量和可靠性.
- 进一步的研究应该探索减少复制行为和理解参与者在线信息搜索的动机.
更多相关视频
00:08A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
6.9K
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
3.8K
相关概念视频
Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Reliability and Validity
12.6K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.6K
Response Surface Methodology
81
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
81
Data Collection by Survey
6.4K
The systematic method of obtaining and analyzing accurate information of a population is called data collection. A survey is a standard method of data collection that involves collecting information from a target human population about their experience, opinion, or knowledge of a product, service, or process. The responses are recorded and interpreted. The most common survey examples are written questionnaires, face-to-face or telephonic conversations, focus groups, and electronic (e-mail or...
6.4K
Naturalistic Observations
15.3K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.3K
Longitudinal Research
11.8K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
11.8K
