在伊朗的医疗执照考试中ChatGPT的表现
Alireza Keshtkar1, Ali-Asghar Hayat2, Farnaz Atighi3
1Research Center of Noncommunicable Diseases, Jahrom University of Medical Sciences, Jahrom, Iran.
Medical journal of the Islamic Republic of Iran
|June 9, 2025
概括
聊天GPT在医学教育方面表现出潜力,在基础科学和实习前水平上,在伊朗医学执照考试中得分超过了通过门. 人工智能模型还提供了推理,强调了它对医疗培训和评估的有用性.
科学领域:
- 人工智能在医学中的应用
- 自然语言处理应用程序
- 医疗教育 技术 技术 医学教育
背景情况:
- OpenAI的ChatGPT是一个1750亿参数变压器模型,用于自然语言处理任务.
- 本研究评估了ChatGPT对伊朗医疗执照考试的知识和解释能力.
研究的目的:
- 评估ChatGPT (特别是ChatGPT 3.5) 在伊朗医疗执照考试中的表现.
- 为了比较ChatGPT在不同考试水平 (基础科学,预实习,预入住) 和语言 (波斯语和英语) 的表现.
主要方法:
- 伊朗医疗执照考试的三个级别被管理到ChatGPT 3.5.5.
- 考试以波斯语和英语进行,其中的版本反映了ChatGPT的互联网访问.
- 答案的准确性和一致性由两名盲人评审员评估.
主要成果:
- 聊天GPT准确地回答了2210个问题中的48.5%,总体一致性为91%.
- 英语问题的准确性 (61.4%) 和一致性 (94.5%) 比波斯语问题的准确性 (35.7%,一致性88.7%) 高.
- 该模型超过了基础科学和实习前考试的通过分数,并满足了居住申请的最低要求.
结论:
- 在某些伊朗医疗执照考试中,ChatGPT表现出超过合格标准的熟练程度.
- 人工智能提供推理的能力表明,它在医疗教育中具有很大的整合潜力.
- 英语和波斯语之间的性能差异表明,语言是人工智能评估准确性的关键因素.
相关概念视频
Pulmonary Function Tests
311
Pulmonary Function Tests (PFTs)
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
311
Assessment of the Gastrointestinal System II: Health Perception Pattern
81
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
81
Assessment of the Abdomen II: Percussion
212
Percussion is a fundamental technique used to assess the liver, spleen, and abdominal organs by tapping the abdomen and interpreting the resulting sounds. This method helps identify fluid, distention, and masses through variations in sound, such as the high-pitched tympany of air-filled areas and the dullness of solid masses. Understanding how to percuss these organs provides valuable information for healthcare professionals in diagnosing conditions early.
Percussion
Percussion is an essential...
Percussion
Percussion is an essential...
212
Imaging Studies II: Positron Emission Tomography and Scintigraphy
91
Positron Emission Tomography (PET) is a medical imaging technique that provides crucial insights into the body's physiological functions at a molecular level. It is an indispensable resource for diagnosing, staging, and monitoring various illnesses, notably cancer, neurological disorders, and cardiovascular conditions.
Fundamental Principles of PET
Fundamental Principles of PET
91
Radiological Investigation III: Pulmonary Angiogram and PET Scan
86
Radiological investigations are paramount in the diagnosis and management of various pulmonary diseases. Two essential investigations are the Pulmonary Angiogram and the Positron Emission Tomography (PET) Scan.
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
Pulmonary Angiogram
A Pulmonary Angiogram is an invasive procedure involving injecting a contrast medium through a catheter threaded into the pulmonary artery or the right side of the heart to visualize the pulmonary vasculature. Computed Tomography (CT) scans have mainly replaced this...
86


