问号选项在进度测试中的影响:一项大型纵向研究
Elise V van Wijk1, Jeroen Donkers2, Peter C J de Laat3
1Center for Innovation in Medical Education, Leiden University Medical Center, The Netherlands.
Perspectives on medical education
|December 8, 2025
概括
在传统的医学进步测试 (PT) 中,问号选项可能会对结果产生偏见. 计算机自适应PT (CA-PT) 显示,使用问号选项的学生表现更好,这表明公式得分不仅仅是知识.
科学领域:
- 医疗教育 医学教育
- 评估和评价的评估和评估.
- 心理测量 心理测量 心理测量
背景情况:
- 在医学进步测试 (PT) 中,传统的公式得分使用一个问号选项来阻止猜测.
- 这一特征可能使不愿冒险的学生处于不利地位,并引入由于考试策略的偏见.
- 荷兰医学院转向计算机自适应PT (CA-PT),使用项目响应理论,动态调整难度并省略问号选项.
研究的目的:
- 评估传统PT中的问号选项对CA-PT的后续表现的影响.
- 通过CA-PT探索传统PT中的问号使用与学生能力评估之间的关系.
- 分析不同学生队伍中问号使用的影响的变化.
主要方法:
- 追溯分析了来自七个学院的医学学生的数据,他们完成了传统PT和CA-PT.
- 评估Z-分数的总和问号分数 (未回答的问题) 在传统的PT中,以及CA-PT中的theta分数.
- 线性建模以确定问号得分对theta的影响,控制常规PT得分;对学生子组进行集群分析.
主要成果:
- 具有类似传统PT分数的学生使用问号选项 (留下更多未回答的问题) 通常在CA-PT上表现更好.
- 观察到,随着学生在学术研究中的进步,这种效应会减弱.
- 集群分析表明学生子组之间存在可变效应,在第四年最为突出,在第五年观察到反向效应.
结论:
- 在公式得分中使用问号选项显著影响学生的成绩,显示出相当大的变化.
- 这种变化表明,公式评分评估的因素超出了纯知识范围,例如测试策略或风险厌恶.
- 将评估得分方法与其预期的教育目标结合起来,对于准确的能力测量至关重要.
更多相关视频
相关概念视频
Longitudinal Research
13.0K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
13.0K
Cochran's Q Test
923
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
923
Longitudinal Studies
449
Longitudinal studies are also widely used in other medical and social science fields. For instance, in cardiovascular research, they can monitor patients' health over decades to identify risk factors for heart disease, such as high cholesterol or smoking, and evaluate the long-term effectiveness of preventive measures. Similarly, in mental health studies, researchers might follow individuals from adolescence into adulthood to understand the development and progression of conditions like...
449
Testing a Claim about Population Proportion
3.9K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.9K
Statistical Hypothesis Testing
6.1K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
6.1K
Detection of Gross Error: The Q Test
6.8K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.8K


