评估医学知识:一项为期3年的比较研究,研究了非常简短的答案与多选题的问题
Harry G Potter1,2, John C McLachlan2
1Division of Neuroscience, School of Biological Sciences, Faculty of Biology, Medicine and Health, Manchester Academic Health Science Centre, University of Manchester, Manchester, United Kingdom.
Medical teacher
|April 28, 2025
概括
非常简短的答案问题 (VSAQs) 与多选题 (MCQs) 相比,产生了更高的学生绩效歧视,尽管得分更低,考试时间更长. 问题类型和特征显著影响结果.
科学领域:
- 医学教育 医学教育
- 评估设计 评估设计
- 学生学习评估 学生学习评估
背景情况:
- 像多选题 (MCQ) 和非常简短的答案问题 (VSAQ) 这样的评估格式在高风险的医学教育中至关重要.
- MCQ 提供效率和可靠性,但可能无法充分评估批判性思维.
- VSAQs要求生成响应,可能会加深评估,但引起对一致性的担忧.
研究的目的:
- 为了比较MCQ和VSAQ在评估学生学习中的有效性.
- 分析问题特征和时间对评估结果的影响.
- 调查不同评估格式的歧视力.
主要方法:
- 收集了三年来并行MCQ和VSAQ考试的数据.
- 分析总结统计数据,包括分数,时间和歧视指数 (DI).
- 评估年度和问题特征对考试成绩的影响.
主要成果:
- VSAQ与较低的成绩 (p < 0.001) 和较长的完成时间 (p < 0.001) 有关.
- 与MCQ相比,VSAQ显示了较高的歧视指数 (DI) (p < 0.001).
- 问题特征显著影响了分数,时间和DI,无论问题格式如何.
结论:
- 虽然MCQ获得了更高的分数,但VSAQ更好地区分学生的成绩.
- 无论形式如何,问题特征都会影响学生的成绩,可能是因为职业发展.
- 建议对VSAQs的预测有效性和基本科学的标准设置进行进一步的研究.
相关概念视频
Multiple Comparison Tests
3.8K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.8K
Cochran's Q Test
144
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
144
Comparing the Survival Analysis of Two or More Groups
90
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
90
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
106
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
106
Metacognition
125
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
125
Kaplan-Meier Approach
57
The Kaplan-Meier estimator is a non-parametric method used to estimate the survival function from time-to-event data. In medical research, it is frequently employed to measure the proportion of patients surviving for a certain period after treatment. This estimator is fundamental in analyzing time-to-event data, making it indispensable in clinical trials, epidemiological studies, and reliability engineering. By estimating survival probabilities, researchers can evaluate treatment effectiveness,...
57


