在以色列希伯来语中ChatGPT的表现 OBGYN国家居留考试
Adiel Cohen1, Roie Alter2, Naama Lessans2
1Department of Obstetrics and Gynecology, Hadassah Medical Organization and Faculty of Medicine, Hebrew University of Jerusalem, Ein Kerem, P.O.B. 12000, 91120, Jerusalem, Israel. adielic@gmail.com.
Archives of gynecology and obstetrics
|September 5, 2023
概括
在希伯来语妇产科医生考试中,ChatGPT表现不佳,正确回答的问题不到40%. 这表明ChatGPT不是一个可靠的工具,居民准备这个医学检查在希伯来语.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 产科和妇科 产科和妇科
背景情况:
- 关于ChatGPT的医疗检查性能之前的研究显示了不同的结果.
- 关于ChatGPT在非英语医学评估中的能力的研究有限.
研究的目的:
- 评估ChatGPT在希伯来妇产科 (OBGYN) "Shlav-Alef" (第一阶段) 考试中的表现.
- 为了比较ChatGPT的希伯来语表现与居民表现及其英语医学测试结果.
主要方法:
- 使用了一套来自正宗希伯来语 OBGYN 'Shlav-Alef' 考试 (2021-2022) 的 150 个多选题.
- 聊天GPT的答案与居民绩效数据和先前发表的英语医学测试结果进行了比较.
主要成果:
- 聊天GPT正确回答了38.7%的希伯来语问题,考试失败了.
- 希伯来语聊天GPT的表现 (38.7%) 显著低于实际居民的表现 (平均得分68.4%,失败率27.8%).
- 希伯来语ChatGPT的表现也低于其在英语医学问题上的表现 (38.7%vs. 60.7%).
结论:
- 聊天GPT不是一个可靠的资源,为希伯来语 OBGYN "Shlav-Alef" 考试做准备.
- 需要进行改进,以提高ChatGPT在医疗评估中使用英语以外的其他语言的性能.
相关概念视频
01:26Endoscopic Studies II: Thoracocentesis
325
Thoracentesis(Thoracocentesis), commonly known as pleural tap, is a medical procedure where a 22 gauge needle is inserted into the pleural space, the area between the lung and chest wall. This procedure is commonly performed to diagnose or treat various respiratory disorders.
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
325
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
139
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
139
01:28Urologic Endoscopic Procedure: Cystoscopic Examination
51
Meaning of Cystoscopic Examination:Cystoscopy is an essential diagnostic tool in urology that is used to assess the structure and function of the genitourinary system. It provides a direct view of the urethra, bladder, and, in some cases, the ureteral openings. This procedure helps detect structural abnormalities, infections, cancers, and blockages in the urinary tract. There are two types of cystoscopy:Flexible cystoscopy is commonly performed in outpatient settings due to its less invasive...
51
01:26Endoscopic Procedures V: ERCP
345
Endoscopic Retrograde Cholangiopancreatography (ERCP) is a diagnostic procedure that combines endoscopy and fluoroscopy to diagnose and treat conditions related to the bile ducts, pancreatic ducts, and gallbladder. This procedure is beneficial for identifying and addressing blockages, gallstones, strictures, and tumors within the biliary or pancreatic systems. ERCP is both diagnostic and therapeutic, offering the ability to visualize and treat identified problems in one session.
Patient...
Patient...
345
01:30Endoscopic Studies I: Bronchoscopy and Thoracoscopy
231
Endoscopy is a non-surgical medical technique used to examine a person's internal organs and vessels. This lesson will focus on two types of endoscopic studies: bronchoscopy and thoracoscopy.
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
231
01:25Endoscopic Procedures II: Colonoscopy
133
The colon, or large intestine, is the final segment of the digestive system. Its primary functions include absorbing water and vitamins produced by gut bacteria and transforming waste from liquid to solid to form stool. In adults, the large intestine is approximately 5 feet long and consists of four main sections:
133