在耳鼻喉科问题库中比较ChatGPT-4,Copilot,Bard和Gemini Ultra
Rashi Ramchandani1,2, Eddie Guo3, Michael Mostowy4
1Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada.
概括
与GPT-4,Copilot和Bard相比,Gemini在耳鼻喉科问题上表现出更高的准确性. 虽然双子座在表现方面领先,但所有大型语言模型都需要医学学习者仔细评估.
科学领域:
- 医学教育 医学教育
- 人工智能在医学中的应用
- 耳鼻喉科 耳鼻喉科 耳鼻喉科
背景情况:
- 大型语言模型 (LLM) 越来越多地被评估为医学教育应用.
- 在耳鼻喉科等专业领域,LLM的准确性和有效性需要进一步研究.
研究的目的:
- 为了比较谷歌Bard,微软Copilot,GPT-4与视觉和Gemini Ultra在耳鼻喉科问题库中的性能.
- 评估这些LLM在专业医疗领域的准确性和响应特性.
主要方法:
- 进行了比较性绩效评估,使用来自六个独立问题库的350个多选项耳鼻喉科问题.
- 问题集包括18个基于图像的问题.
- 四个大型语言模型 (LLM) 负责回答问题并提供推理,并记录了响应的长度.
主要成果:
- 双子号获得了最高的精度 (79.8%),其次是GPT-4 (71.1%),Copilot (68.0%) 和Bard (65.1%).
- 双子号和GPT-4成功地回答了基于图像的问题,展示了多式联运能力.
- 响应的长度差异很大,Bard提供了最长的详细解释,GPT-4/Copilot提供了最短的详细解释.
结论:
- 在评估的LLMs中,双子座在耳鼻喉科问题的准确性方面表现最好.
- GPT-4提供了简洁和相关的解释,仅次于双子座的准确性.
- 医学学习者必须批判性地评估LLM产生的内容的准确性和可靠性,以便做出决策.
相关概念视频
Endoscopic Studies I: Bronchoscopy and Thoracoscopy
154
Endoscopy is a non-surgical medical technique used to examine a person's internal organs and vessels. This lesson will focus on two types of endoscopic studies: bronchoscopy and thoracoscopy.
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
154
Endoscopic Studies II: Thoracocentesis
185
Thoracentesis(Thoracocentesis), commonly known as pleural tap, is a medical procedure where a 22 gauge needle is inserted into the pleural space, the area between the lung and chest wall. This procedure is commonly performed to diagnose or treat various respiratory disorders.
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
185
Assessment of Airway, Skin Color, and Use of Accessory Muscles
947
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
947
Physical Assessment of the Respiratory Tract IV: Auscultation
246
Auscultation is a crucial component of the physical assessment of the respiratory tract. It offers valuable insights into airflow through the bronchial tree and potential lung obstructions. This process involves careful listening to breath, voice, and adventitious sounds, which can reveal a wealth of information about a patient's respiratory health.
Breath Sounds
Breath sounds are categorized into vesicular, bronchovesicular, and bronchial.
Breath Sounds
Breath sounds are categorized into vesicular, bronchovesicular, and bronchial.
246
Endoscopic Procedures III: Video Capsule Endoscopy
66
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
66
Respiratory System Abnormal Finding II: Palpation and Auscultation
243
In assessing respiratory abnormalities, palpation and auscultation are critical tools for detecting and interpreting various pathophysiological changes. These techniques provide insight into underlying disorders by evaluating tactile sensations and sounds produced by the respiratory system.
Palpation Findings
During a respiratory assessment, palpation can reveal several vital abnormalities:
Palpation Findings
During a respiratory assessment, palpation can reveal several vital abnormalities:
243


