牙科知识测试的标准设置:修改后的Angoff和Ebel方法在法官之间可重复性
Ting Khee Ho1,2, Noor Lide Abu Kassim3, Lucy O'Malley4
1Division of Dentistry, School of Medical Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, University of Manchester, Oxford Road, Manchester, M13 9PL, UK. tingkhee.ho@ukm.edu.my.
BMC medical education
|October 15, 2025
概括
修改的Angoff和Ebel标准设定方法在牙科评估中的可重复性.根据测试格式和小组而异. 短答案问题 (SAQ) 显示出一致的通过分数,与一个最佳答案 (OBA) 问题不同.
科学领域:
- 牙科教育 牙科教育
- 评估和评价的评估和评估.
- 心理测量 心理测量 心理测量
背景情况:
- 以标准为参考的标准设定方法对于在教育评估中建立可辩护的通过分数至关重要.
- 验证证据对于支持基于标准设定方法得出的分数的可信度至关重要.
- 本研究研究了修改后的Angoff和Ebel标准设定方法在牙科评估中的可重复性.
研究的目的:
- 评估修改的Angoff和Ebel标准设定方法在不同测试格式 (OBA和SAQ) 和专家小组中的可重复性.
- 在牙科评估中评估这些标准设定方法的评价者间可靠性.
主要方法:
- 12名牙科专家被分为两个小组 (A组和B组).
- 每个小组都采用修改后的Angoff和Ebel方法来设定一个最佳答案 (OBA) 和短答案问题 (SAQ) 的通过分数.
- 统计分析包括曼·惠特尼U测试,威尔科克森签名等级测试,类内相关系数 (ICC) 和弗莱斯卡帕.
主要成果:
- 可复制性各不相同;SAQ通过分数在各个小组中一致,而OBA分数则不同.
- A组在修改后的Angoff和Ebel通过分数之间没有明显的差异,无论是OBA还是SAQ.
- 与Ebel相比,B组在OBA和SAQ方面表现出明显更高的通过分数,使用修改后的Angoff. 在A组,评价者间的一致性更高.
结论:
- 在牙科评估中修改的Angoff和Ebel标准设定方法的可复制性是混合的,取决于测试格式.
- 与OBA不同的是,SAQ的通过分数在法官和方法之间是一致的.
- 研究结果强调,在建立牙科知识评估的可靠通过标准时,需要仔细考虑.
相关概念视频
01:19Testing a Claim about Standard Deviation
2.9K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.9K
01:21Friedman Two-way Analysis of Variance by Ranks
478
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
478
01:52Regression Toward the Mean
6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K
01:10Bonferroni Test
3.3K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.3K