正确选项的位置和干扰因素对多选项的反应产生影响:来自国家测试的证据
Séverin Lions1, Pablo Dartnell1, Gabriela Toledo1
1Universidad de Chile, Santiago de Chile, Chile.
Educational and psychological measurement
|September 4, 2023
概括
在多项选择测试中正确答案和分心的位置会影响学生的反应. 一项大规模研究的结果表明,特定的选项配置可以轻微改变测试难度,影响教育测量.
科学领域:
- 教育测量和心理测量学
- 认知心理学 认知心理学
背景情况:
- 响应选项位置对多项选择项表现的影响是教育测试中长期存在但尚未解决的争论.
- 之前的研究未能得出结论,原因是从大规模实验中获得的实验数据有限,现实世界的背景和对正确反应和分心位置的操纵不足.
研究的目的:
- 在高风险的标准化测试中,实验性地研究正确反应和分散注意力的位置对受试者的反应的影响.
- 澄清和扩展以前关于期权位置效应及其对多选项评估中测量错误的影响的研究结果.
主要方法:
- 进行了两项实验,操纵了多重选择项目的正确反应和分心的位置.
- 利用了来自195,715名参加智利国家高风险标准化测试的受试者的数据.
- 分析了响应模式,以确定选项配置的系统效应.
主要成果:
- 观察到选项位置对受试者答案的小但明确和系统的影响.
- 发现,当正确的答案处于位置A与E时,五个选项项目稍微容易.
- 证明项目难度受到与正确答案相比有吸引力的分心因素的放置的影响,影响了整体选项吸引力.
结论:
- 选项位置在多选项测试中显著影响受试者的答案,即使是在大规模的高风险评估中.
- 调查结果提供了经验证据,阐明了期权位置效应和潜在干扰现象的性质.
- 结果对测试开发有直接影响,建议仔细考虑选项排序以尽量减少测量误差.
相关概念视频
01:08The Availability Heuristic
6.0K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.0K
01:03Serial Position Effect
196
The serial position effect is a cognitive phenomenon where individuals are more likely to recall the first and last items in a list compared to those in the middle. This effect is divided into the primacy effect and the recency effect. The primacy effect is observed when the initial items in a list are remembered better. This occurs because these items are rehearsed more frequently or receive more elaborative processing, allowing them to be encoded into long-term memory more effectively. For...
196
01:14Fundamental Attribution Error
12.9K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.9K
02:01Group Design
9.0K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
9.0K