在以色列希伯来语内科医学国家住院考试中执行ChatGPT
David J Ozeri1, Adiel Cohen2, Noa Bacharach3
1Division of Rheumatology, Sheba Medical Center, Tel Hashomer, Israel.
The Israel Medical Association journal : IMAJ
|February 29, 2024
概括
在希伯来语Shlav Aleph内科考试中,ChatGPT 3.5表现不佳,只回答了36.6%的正确答案. 需要进一步的研究来适应人工智能语言模型用于希伯来语医学考试准备.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 医学执照考试 医学执照考试
背景情况:
- 在以色列,内部医学专业培训需要通过Shlav Aleph考试.
- 聊天生成预训练变压器 (ChatGPT) 3.5是一种日益用于医学考试准备的语言模型.
- 人工智能在希伯来语医学检查中的有效性在很大程度上仍未被探索.
研究的目的:
- 评估ChatGPT 3.5能够成功通过以希伯来语进行的以色列国家内科医学考试的能力.
- 在非英语语境内对AI性能进行比较,与非英语语境内的临界医疗许可审查进行比较.
主要方法:
- 使用了2023年Shlav Aleph考试,包括133个多项选择题.
- 通过希伯来语提示,向ChatGPT 3.5进行了考试问题.
- 将ChatGPT 3.5的答案与考试上诉期后的官方答案密钥进行了比较.
主要成果:
- 在2023年的Shlav Aleph考试中,ChatGPT 3.5取得了36.6%的成绩.
- 在各种医疗主题中,表现相对一致.
- 在科和生物统计学部分观察到显著的困难.
结论:
- 在希伯来语Shlav Aleph考试中,ChatGPT 3.5的表现明显低于其在英语医学考试中取得的成功.
- 潜在的因素包括希伯来训练数据的局限性,语言翻译细微差别和独特的语言结构.
- 进一步的研究对于提高人工智能语言模型在希伯来语医学考试准备中的有效性至关重要.
相关概念视频
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
114
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
114
01:26Endoscopic Studies II: Thoracocentesis
258
Thoracentesis(Thoracocentesis), commonly known as pleural tap, is a medical procedure where a 22 gauge needle is inserted into the pleural space, the area between the lung and chest wall. This procedure is commonly performed to diagnose or treat various respiratory disorders.
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
258
01:30Serum Laboratory Studies, Stool Test, Breath Test
346
Gastrointestinal (GI) diagnostic studies are pivotal in confirming, ruling out, diagnosing, or staging various diseases, including cancers. Following diagnosis, allocating time for discussions with the patient and providing informational resources is crucial. Diagnostic assessments of the GI tract often occur in outpatient settings like endoscopy suites or GI labs. Preparation for these tests may include dietary restrictions, fasting, liquid bowel preparations, laxatives, enemas, and the...
346