通过使用自然语言处理在工作场所的评估中对反映和反质量的自动评估:跨部门基于能力的医学教育研究
Jeng-Wen Chen1,2,3,4, Hai-Lun Tu5, Chun-Hsiang Chang1,2
1Department of Otolaryngology-Head and Neck Surgery, Cardinal Tien Hospital, Fu Jen Catholic University, New Taipei City, Taiwan.
JMIR medical education
|October 22, 2025
概括
自然语言处理 (NLP) 模型,特别是BERT,在医学教育评估中有效评估叙事质量. 这项技术有助于监测趋势并改善基于能力的培训的反.
科学领域:
- 医学教育 医学教育
- 自然语言处理自然语言处理.
- 人工智能的人工智能
背景情况:
- 基于能力的医学教育 (CBME) 需要高质量的叙事反思和对工作场所评估的反.
- 在规模上评估这些叙述对教育工作者来说是一个重大挑战.
研究的目的:
- 开发和应用自然语言处理 (NLP) 模型来评估居民反思和教师反的质量.
- 评估这些模型在台湾全国可信任的专业活动 (EPAs) 平台内用于耳鼻喉科住院培训.
主要方法:
- 一项为期四年的横截面研究分析了300个随机抽取的EPA评估.
- 两位医学教育专家对叙述进行了相关性,特异性和反思性语言的评价,将其分为四个质量级别.
- 逻辑回归,支持向量机和BERT模型进行了比较,以进行叙事质量分类.
主要成果:
- 伯特模型在居民反射的二元分类中达到85%的准确性,在教师反中达到92%的准确性.
- 纵向分析显示,高质量的反射 (70.3%至99.5%) 和反 (50.6%至88.9%) 显著增加.
结论:
- 基于BERT的NLP模型在评估EPA评估中评估叙事质量的准确度中等至高.
- 在CBME中,NLP为监测趋势和增强形成性反提供了有价值的工具,补充了专家审查.
相关概念视频
Methods of Documentation V: CBE
1.4K
Charting by Exception, or CBE, is a method of documentation used in healthcare, particularly in nursing, that focuses on documenting only significant or abnormal findings rather than recording every detail. This approach aims to streamline the documentation process, improve efficiency, and ensure that healthcare providers can quickly identify deviations from normalcy in patient assessments.
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
1.4K
Nursing Process for Patient and Caregiver Teaching III: Evaluation and Documentation
2.4K
Evaluation of the teaching process enables the nurse to determine if the patient's learning needs were met and if training was effective. If the expected outcomes are not met, the care plan is revised, and additional education or reinforcement is provided. Nurses can ask questions after the session or obtain feedback to assess the patient's understanding of the topic.
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
Nurses can use several methods to evaluate patient outcomes. For example, oral questions can assess cognitive learning,...
2.4K
Nursing Evaluation
4.1K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
4.1K
Self-Evaluation Maintenance Model
272
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
272
Self-Evaluation: Self-Enhancement and Self-Verification
5.7K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.7K
Role of Communication in the Nursing Process III: Evaluation and Documentation
1.9K
A successful patient outcome depends mainly on the evaluation stage of the nursing process. Evaluation determines effectiveness by reviewing what was done previously after the completion of nursing interventions. Every time a healthcare professional steps in or administers treatment, they must reassess or evaluate the action to ensure the intended result. During the evaluation phase, there are three probable patient outcomes:
1.9K
