测量和预测教师共识 标准化评价函数的排名
Morgan Sehdev1, Benjamin Schnapp2, Nicole M Dubosh3
1is a PGY-2 Resident Physician, Harvard-Affiliated Emergency Medicine Residency, Brigham and Women's Hospital, Massachusetts General Hospital, Boston, Massachusetts, USA.
Journal of graduate medical education
|February 2, 2024
概括
标准化评估信 (SLOE) 显示了在评估申请人竞争力方面,教师的强烈共识. 预测模型准确地预测这些共识排名,支持在选择中使用SLOE.
科学领域:
- 医学教育 医学教育
- 住院招生 住院招生
- 进行外科手术培训.
背景情况:
- 标准化的评估信件 (SLOE) 旨在对居住申请审查进行客观化.
- 审查人员对基于SLOE的申请人竞争力的共识尚未建立.
- 了解教师协议对于完善住院选择过程至关重要.
研究的目的:
- 用SLOEs测量教师对申请人竞争力的协议.
- 评估两个算法对教师共识排名的预测准确度.
- 为了验证SLOE在住院招生中的实用性.
主要方法:
- 50个虚构的SLOE基于2021-2022紧急医疗比赛的国家数据而创建.
- 七名教职员工根据申请人的竞争力对这些SLOE进行了排名.
- 测试了两个模型 (基于点的系统和线性回归) 的预测准确性.
主要成果:
- 在解释SLOE方面观察到强烈的教师共识,分别在密闭和松散窗口方面达成83%和93%的同意.
- 这两种预测模型都与教师共识排名有很高的相关性 (r=0.97).
- 这些发现表明,通过SLOE可靠地解释和预测申请人的竞争力.
结论:
- 教师在通过SLOEs评估申请人的竞争力方面表现出强烈的共识.
- SLOEs是选择居留权和向申请人提供咨询的宝贵工具.
- 开发的模型准确地预测基于共识的竞争力排名.
相关概念视频
Ranks
236
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
236
Review and Preview
7.5K
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...
7.5K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Kendall's Coefficient of Concordance
339
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
339
Friedman Two-way Analysis of Variance by Ranks
197
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
197


