一个实验性比较的多选项和短答案问题在一个高风险测试的医学学生
Janet Mee1, Ravi Pandian1, Justin Wolczynski1
1NBME, Philadelphia, USA.
Advances in health sciences education : theory and practice
|September 4, 2023
概括
在高风险考试中,短答题 (SAQ) 比多选择题 (MCQ) 难,时间更长. 尽管响应时间较长,但SAQ提供了稍微更好的歧视,支持在响应生成是关键时使用它们.
科学领域:
- 医学教育 医学教育
- 评估和评价的评估和评估.
背景情况:
- 在大规模评估中,自动评分的进步使得多选题 (MCQ) 可以被短答题 (SAQ) 取代.
- 以前的研究经常使用小样本和低风险条件,缺乏响应时间的数据.
研究的目的:
- 在一个大规模的,高风险的内科医学评估中,比较SAQ与MCQ的难度,歧视和时间要求.
- 调查增加困难对SAQ歧视的影响.
主要方法:
- 71个MCQ被转换为SAQ,并在高风险的内部医学评估中随机分配给受试者.
- 受试者在两个格式中都没有遇到相同的项目.
- 分析了两种格式的难度,歧视指数和响应时间.
主要成果:
- 一般来说,SAQ项目比MCQ项目更难.
- 与MCQ相比,SAQ的歧视指数略高.
- 对SAQ的响应时间比MCQ要长得多.
结论:
- SAQ和MCQ在很大程度上可以互换,当响应生成至关重要时,SAQ是首选的.
- 对SAQs所需的较长时间可能会限制在固定的测试期内管理的问题数量,可能会抵消它们更高的歧视.
- 关于困难和歧视的发现与以前的研究一致,而响应时间数据提供了新的见解.
更多相关视频
06:28E-Patient Counseling Trial E-PACO: Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
8.4K
07:32Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity
Published on: February 10, 2016
9.4K
相关概念视频
Multiple Comparison Tests
3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Comparing the Survival Analysis of Two or More Groups
222
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
222
Cochran's Q Test
387
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
387
Comparing Experimental Results: Student's t-Test
1.6K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.6K
McNemar's Test
298
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
298
