差异性项目的作用对使用韩国医学执照考试与计算机化适应性测试对能力估计的影响:一项后期模拟研究
Dogyeong Kim1, Jeongwook Choi1, Dong Gi Seo1
1Department of Psychology, College of Social Science, Hallym University, Chuncheon, Korea.
Journal of educational evaluation for health professions
|January 25, 2026
概括
在计算机化适应性测试 (CAT) 中排除差异性功能项目 (DIF) 项目提高了能力估计的准确性和公平性,特别是在多样化的受试者身上. 这种管理可以提高高风险考试的精度.
科学领域:
- 心理测量 心理测量 心理测量
- 教育测量教育的测量
- 计算机化的适应性测试
背景情况:
- 差异性项目功能 (DIF) 可以在能力估计中引入偏差.
- 计算机自适应测试 (CAT) 环境需要强大的方法来确保准确的测量.
- 像韩国医学执照考试 (KMLE) 这样的高风险考试的现实数据对于验证心理测量模型至关重要.
研究的目的:
- 调查排除基于性别的DIF项目对CAT环境中的能力估计准确性的影响.
- 评估是否删除DIF项目可以提高能力估计的公平性和准确性,特别是对于能力尺度极端的考生.
- 在高风险的CAT中提供以公平为导向的测试设计的实际证据.
主要方法:
- 使用基于残余的DIF方法检测了来自3,259名受试者的数据的差异性项目功能 (DIF).
- 模拟了两个CAT条件:一个包含所有项目,一个不包括DIF项目.
- 使用偏差,根平均平方误差 (RMSE) 和相关性,将能力估计与"true θ"进行比较.
主要成果:
- 除了DIF项目,提高了准确性,减少了RMSE,并增加了与真实能力的相关性.
- 删除DIF减少了女性的低估,但增加了男性的低估,导致跨性别的更公平的估计.
- 当包括DIF项目时,估计错误在能力规模的低端和高端更为明显.
结论:
- 在CAT中管理DIF对于提高高风险测试中的公平性和精度至关重要.
- 本研究展示了DIF在使用真实受试者数据进行基于CAT的测量中的实际含义.
- 实施以公平为导向的测试设计原则可以提高标准化评估的质量.
相关概念视频
Serum Studies: Renal Function Tests
403
Renal function tests are crucial for assessing kidney health, monitoring disease progression, and evaluating the kidneys' efficiency in waste elimination, fluid balance, and electrolyte regulation. These tests offer critical insights into kidney function, even though routine measurements may appear normal until there is a significant decline in the glomerular filtration rate or GFR. Typically, signs of kidney impairment only become evident when the GFR falls to about 50% of its normal level.
403
Pulmonary Function Tests
779
Pulmonary Function Tests (PFTs)
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
779
What are Estimates?
8.2K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates.
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
8.2K
Impact of Groups on Groups
238
Social psychologists analyze how groups influence one another, shaping social structures and interactions through both cooperation and competition. These dynamics manifest in various ways, ranging from economic partnerships to intergroup conflicts that shape societal structures and perceptions.Cooperation and Competition in Intergroup RelationsIntergroup relationships vary across contexts, sometimes fostering cooperation and mutual benefit while at other times leading to conflict and...
238
Impact
487
Impact occurs when two bodies collide, leading to the application of impulsive forces between them. Analyzing impact mechanics involves considering two colliding particles moving along a line known as the line of impact, which passes through their centers and is perpendicular to the contact plane.
When particles with different initial velocities collide, they induce deformation by applying equal and opposite impulses. At the point of maximum deformation, the particles move together with...
When particles with different initial velocities collide, they induce deformation by applying equal and opposite impulses. At the point of maximum deformation, the particles move together with...
487
Estimation of k and VD of Aminoglycosides
227
Aminoglycosides are a class of antibiotics used to treat various bacterial infections. Clinicians must determine the elimination rate constant (k) and volume of distribution (VD) to optimize therapeutic efficacy and minimize toxicity. The k value represents the rate at which the drug is removed from the body, and the VD reflects the degree to which the drug distributes into body tissues. Accurately estimating these parameters allows healthcare professionals to tailor drug dosing to individual...
227


