在考官的毕业级别OSCE判断标准的校际差异
Peter Yeates1, Adriano Maluf2, Gareth McCray1
1School of Medicine, Keele University, Keele, United Kingdom.
Medical teacher
|July 8, 2024
概括
在客观结构化临床考试 (OSCE) 中,医学院之间的考官得分差异可以显著影响学生的通过/失败率. 一种新的方法,基于视频的考生分数比较和调整 (VESCA),有助于识别和调整这些关键的变化.
科学领域:
- 医学教育 医学教育
- 评估和评价的评估和评估.
背景情况:
- 确保高风险的绩效考试中的公平性和患者安全性至关重要.
- 考官判断的校际变化可能会影响学生的成绩.
研究的目的:
- 在一个共同的目标结构化临床检查 (OSCE) 中,比较医学院之间的检查员差异.
- 评估这些差异对学生通过/失败分类的影响.
- 评估基于视频的考生分数比较和调整 (VESCA) 方法的有效性.
主要方法:
- 一个共享的,六个站形成的欧安组织在4个医学院异步进行.
- 考官使用了基于视频的考官分数比较和调整 (VESCA) 方法,与现场表演一起评分视频.
- 通过VESCA,可以对考官的判断进行由队列和学校进行的受控比较,从而允许进行分数调整.
主要成果:
- 学校间考官得分变化 (16.3%) 几乎是学校内部变化 (8.8%) 的两倍.
- 学生的成绩需要5.26%的中位数调整,以考虑到考官差异.
- 调整显著改变了通过/失败分类,一所学校的失败率从39.13%降至8.70%,而另一所学校的失败率从0.00%增加到21.74%.
结论:
- 在欧安组织的医学院之间,检查员的判断存在显著差异.
- 这些变化可以显著影响学生的通过/失败结果.
- 维斯卡方法提供了一种可行的方法,用于识别和解决校际考官差异,以确保评估等价性.
更多相关视频
00:08A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
7.0K
06:54A Virtual Simulation Experiment of Mechanics: Material Deformation and Failure Based on Scanning Electron Microscopy
Published on: January 20, 2023
2.2K
相关概念视频
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Ratio Level of Measurement
17.8K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
17.8K
Comparing Experimental Results: Student's t-Test
1.5K
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
1.5K
Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
Obedience
32.9K
According to obedience research, we may harm others under the forceful pressures of an authority figure (Milgram, 1974). How about if the inappropriate orders were delivered with less force? The increasing interdependence between nurses and physicians compelled Hofling and his colleagues to explore nurses’ reactions to a potentially harmful medical request made by the perceived authority figure, the doctor (Hofling, Brotzman, Dalrymple, Graves, & Pierce, 1966). In this situation,...
32.9K
Range Rule of Thumb to Interpret Standard Deviation
9.0K
The range rule of thumb in statistics helps us calculate a dataset's minimum and maximum values with known standard deviation. This rule is based on the concept that 95% of all values in a dataset lie within two standard deviations from the mean.
For instance, the range rule of thumb can be used to find the tallest and the shortest student in a class, given the mean student height and standard deviation. If the mean student height is 1.6 m and the standard deviation, s is 0.05 m, the height...
For instance, the range rule of thumb can be used to find the tallest and the shortest student in a class, given the mean student height and standard deviation. If the mean student height is 1.6 m and the standard deviation, s is 0.05 m, the height...
9.0K
