一个多面的拉什测量模型方法来调查客观结构化临床检查项目参数漂移
Karen Coetzee1, Sandra Monteiro2, Luxshi Amirthalingam3
1Assessment Consultant and Psychometrician at Construct Measures, An Organization with a Focus on Assessment within Regulated Health Professions, Toronto, Ontario, Canada.
Journal of evaluation in clinical practice
|July 29, 2024
概括
重用目标结构化临床检查 (OSCE) 病例显示项目参数漂移 (IPD),但在评估中保持稳定. 对于准确的临床能力评估,持续监测和对检查员影响的核算至关重要.
科学领域:
- 医学教育研究 医学教育研究
- 心理测量 心理测量 心理测量
- 护理评估 护理评估
背景情况:
- 客观结构化临床检查 (OSCE) 对于评估临床能力至关重要,特别是在高风险的医疗执照方面.
- 跨行政部门重复使用欧安组织案件可能导致项目参数漂移 (IPD),可能影响评估有效性.
- 了解和量化IPD对于保持标准化临床评估的可靠性至关重要.
研究的目的:
- 在重新使用的欧安组织案件中调查项目参数漂移 (IPD).
- 在IPD的分析中考虑考官得分效应.
- 用多面拉什测量 (MFRM) 模型评估欧安组织案件的稳定性.
主要方法:
- 对12个欧安组织案例的分析在国际教育护士能力评估计划 (IENCAP) 的七个行政部门中重新使用.
- 应用多面拉什测量 (MFRM) 模型来评估项目参数漂移.
- 在MFRM分析中包括考官评分效应.
主要成果:
- 所有分析的欧安组织案例都显示出某种程度的项目参数漂移 (IPD),平均为0.21 logit.
- 三个案例显示了IPD的积极方向趋势.
- 在1.19%的估计中,IPD显著影响了得分决策,不变违反了0.58逻辑.
结论:
- 欧安组织的病例表现出足够的稳定性,可以重复使用,但需要对IPD进行持续监测.
- 多面拉什测量 (MFRM) 模型为追踪和减轻IPD提供了一个强大的框架.
- 解决审查员评分的影响对于确保欧安组织评估的准确性和可靠性至关重要.
更多相关视频
相关概念视频
Random and Systematic Errors
10.9K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
10.9K
Uncertainty in Measurement: Accuracy and Precision
73.6K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
73.6K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K


