标准设置语句:两种不同的方法的双重交叉试验
Steven Burr1, Theresa Martin1, James Edwards1
1Peninsula Medical School.
MedEdPublish (2016)
|March 15, 2024
概括
一种新的标准制定方法侧重于知识的重要性,而不是项目难度. 与Angoff方法相比,这种方法可以获得更高的分数和提高法官信心.
科学领域:
- 教育测量教育的测量
- 心理测量 心理测量 心理测量
背景情况:
- 安戈夫方法是一种广泛使用的标准设定技术.
- 这种方法的哲学可接受性受到质疑.
- 建议采用另一种标准制定方法.
研究的目的:
- 评估一种替代的标准制定方法.
- 要将这种新方法直接与Angoff方法进行比较.
- 评估替代方法的实用性和结果.
主要方法:
- 采用了一个潜在的交叉设计.
- 两组法官 (n=7和n=8) 制定了两个100项多选择题测试的标准.
- 每组都使用了Angoff方法和替代方法.
主要成果:
- 这两种方法都需要相似的完成时间.
- 另一种方法导致12-14%更高的切割分数.
- 另一种方法显示,法官的分数变化率增加了5%,法官信心增加了3%.
结论:
- 引入了一种新的标准制定方法.
- 这种替代方法比Angoff方法具有质量优势.
- 观察到方法之间的定量差异很小.
相关概念视频
01:16Crossover Experiments
2.8K
Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
2.8K
02:07Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
02:01Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K
01:13Randomized Experiments
6.9K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.9K
01:11Blinding
2.4K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
2.4K
01:21Friedman Two-way Analysis of Variance by Ranks
194
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
194