GPT-4/4V在日本国家医疗执照考试中的表现
1Department of Clinical Information Applied Sciences, Tokyo Medical and Dental University, Tokyo, Japan.
Medical teacher
|April 22, 2024
概括
人工智能 (AI) 在日本国家医学执照考试 (NMLE) 中表现出熟练,包括基于图像的问题. 这种人工智能工具符合最低通过标准,突出了其在医学教育和实践中的潜力.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
背景情况:
- 人工智能 (AI) 正在迅速发展,影响包括医学在内的各种专业领域.
- 人工智能的临床能力越来越多地通过标准化的医学检查来评估.
- 这项研究的重点是评估一个特定的AI,ChatGPT,与日本国家医疗执照考试 (NMLE) 相比.
研究的目的:
- 评估OpenAI的ChatGPT在日本国家医疗执照考试 (NMLE) 的表现.
- 评估AI能够回答NMLE问题的能力,包括那些具有视觉组件 (图像,插图,图片) 的问题.
主要方法:
- 从日本卫生,劳动和福利部获得了六年的NMLE问题 (112th-117th).
- 将NMLE问题转换为JavaScript对象标记 (JSON) 格式.
- 开发了一个API,使用GPT-4和GPT-4V (视觉) 来处理和回答问题,包括基于图像的查询.
主要成果:
- 在6年内,基于图像的问题占NMLE的30.1% (723/2400).
- 在所有考试年份中,GPT-4/4V始终超过了最低通过分数.
- 对基础医学知识的正确答案率为73.5%,临床知识为74.7%,基于图像的问题为68.7%.
结论:
- 人工智能,特别是GPT-4/4V,在NMLE上满足了最低性能标准,无论问题格式 (文本,图像,插图) 是什么.
- 这些发现表明,人工智能在医学教育和评估中的应用有很大的潜力.
相关概念视频
Assessment of the Gastrointestinal System II: Health Perception Pattern
107
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
107
Pulmonary Tuberculosis IV
142
Tuberculosis, more commonly referred to as TB, is an infectious disease stemming from Mycobacterium tuberculosis. While it primarily impacts the lungs, TB can also affect other body areas. Given its severity and global impact, timely and accurate diagnosis is crucial for controlling its spread and improving patient outcomes.
Several diagnostic approaches are used to detect TB. The conventional method is the Tuberculin Skin Test (TST), also known as the Mantoux test. However, this method has...
Several diagnostic approaches are used to detect TB. The conventional method is the Tuberculin Skin Test (TST), also known as the Mantoux test. However, this method has...
142
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
79
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
79
Positron Emission Tomography
4.2K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.2K
Pulmonary Function Tests
330
Pulmonary Function Tests (PFTs)
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
Pulmonary Function Tests are crucial diagnostic tools for assessing respiratory function, particularly in patients with chronic respiratory disorders. They comprehensively evaluate lung volumes, ventilatory function, breathing mechanics, diffusion, and gas exchange. These tests help diagnose pulmonary diseases and play a significant role in monitoring disease progression, evaluating disability, and assessing response to therapy.
PFTs involve using a spirometer, a...
330
The Professional Nurse
4.2K
Professional nurses are not limited to bedside care and are taking roles of greater responsibility. A nurse should have a knowledge-based practice, including personal, theoretical, procedural, cultural, and reflexive knowledge. Additionally, nurses must be competent in cognitive, technical, interpersonal, and ethical/legal skills. Some of the best attributes of successful nurses include the following:
Communication skills: These are critical characteristics, especially speaking and listening.
Communication skills: These are critical characteristics, especially speaking and listening.
4.2K


