调整居民评分器宽容性或严重性提高了常规居民评估的可靠性教师麻醉师的麻醉师
Franklin Dexter1, Terrie Vasilopoulos2, Brenda G Fahy3
1Anesthesia, University of Iowa, Iowa City, USA.
Cureus
|July 21, 2025
概括
麻醉师的教师绩效评估是不可靠的,因为评价者偏见. 为准确评估,调整评级者宽容度/严格度至关重要,正如多个机构所证明的那样.
科学领域:
- 医学教育 医学教育
- 麻醉学 麻醉学
- 统计分析 统计分析
背景情况:
- 研究生医学教育认证委员会 (ACGME) 授权每年进行教师绩效评估.
- 整个大学的政策还要求每年进行教师审查,使这些高风险评估.
- 这些评估的可靠性至关重要,以避免在绩效评估中出现I型和II型错误.
研究的目的:
- 调查有关教师绩效评估不可靠性的调查结果的概括性,当评估者宽容/严重性未经调整时.
- 评估评级者宽容/严厉对麻醉师绩效评估统计可靠性的影响.
- 将结果与多伦多大学和爱荷华大学的先前研究进行比较.
主要方法:
- 在2018-19学年利用了佛罗里达大学的11项评估.
- 分析了来自85个评价者 (住院医生) 的3302个评价,评估了108个评价者 (麻醉师).
- 使用的统计方法包括eta-squared,Shapiro-Wilk测试,logit分析和类内相关系数.
主要成果:
- 评级者 (eta平方0.40) 的得分异质性比评价者 (0.22) 的得分异质性更大,这与多伦多大学的研究结果一致.
- 原始尺度中的Rater和Ratee分数分布没有正常分布,类似于爱荷华大学的数据.
- 在对评级者宽容/严厉程度进行调整后,发现7个比率明显低于平均水平,17个比平均水平高,与未经调整的分析相比为0个.
结论:
- 住院医生的常规教师评估在没有对评价者偏差进行调整的情况下,会产生统计学上不可靠的结果.
- 如果未能根据评级者宽容/严厉性进行调整,则会导致不准确的绩效分类.
- 评级者调整的必要性似乎是多个机构在例行评估中普遍存在的发现.
更多相关视频
09:52Setting Up a Stroke Team Algorithm and Conducting Simulation-based Training in the Emergency Department - A Practical Guide
Published on: January 15, 2017
17.3K
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
7.6K
相关概念视频
Local Anesthetics: Differential Sensitivity of Nerve Fibers
938
Local anesthetics (LAs) block the sodium channels of nerve trunks, sensory nerve endings, and neuromuscular junctions. Although LAs can block all kinds of nerves, the sensitivity of nerve fibers differs according to nerve types and structures. LAs are known to block myelinated fibers faster than unmyelinated ones. Also, they block pain or sensory neurons at low concentrations without affecting the motor neurons involved in muscle contractions. This helps relieve labor pain without affecting the...
938
Assessment of Ventilation I: Respiratory Rate
1.3K
Assessment of Ventilation
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
1.3K
Obedience
33.1K
According to obedience research, we may harm others under the forceful pressures of an authority figure (Milgram, 1974). How about if the inappropriate orders were delivered with less force? The increasing interdependence between nurses and physicians compelled Hofling and his colleagues to explore nurses’ reactions to a potentially harmful medical request made by the perceived authority figure, the doctor (Hofling, Brotzman, Dalrymple, Graves, & Pierce, 1966). In this situation,...
33.1K
Assessment of Airway, Skin Color, and Use of Accessory Muscles
1.1K
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
1.1K
Local Anesthetics: Adverse Effects
493
While local anesthetics are generally safe and well-tolerated, they can occasionally cause adverse effects that vary in severity. Local anesthetics can induce toxicity at two distinct levels. They can either produce local effects through direct contact with the neural elements or be absorbed into the bloodstream from the injection site, leading to systemic effects.
Once absorbed into the systemic circulation, local anesthetics can affect the organs that depend on the functioning of sodium...
Once absorbed into the systemic circulation, local anesthetics can affect the organs that depend on the functioning of sodium...
493
Assessment of Respiration
1.3K
The respiratory system's basic structures and primary functions lay the foundation for nurses' comprehensive respiratory assessments. This assessment includes subjective and objective data to gauge the patient's respiratory health.
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
Subjective Assessment: Nurses interview the patient to gather information directly during the subjective assessment. It includes questions about the individual's medical history, medications, and symptoms, focusing on past respiratory conditions like...
1.3K
