胃肠病学家和多模式LLM在内镜EREFS评分中对Eosinophilic食道炎的表现
Asaf Levartovsky1, Lior Dar1, Shmuel Fay1
1Department of Gastroenterology, Sheba Medical Center, Israel; Gray Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
概括
多模式大语言模型 (LLM) 在分级异性食道炎 (EoE) 内镜图像方面显示了可变的准确性. 少数射击提示显著改善了LLM的表现,使其与胃肠病专家相提并论.
科学领域:
- 胃肠病学 胃肠病学
- 人工智能的人工智能
- 医学成像分析 医学成像分析
背景情况:
- 在胃肠道 (GI) 图像分析中对多式大型语言模型 (LLM) 的有限评估.
- 需要评估异性食管炎内镜参考评分 (EREFS) 的准确性,以诊断异性食管炎 (EoE).
研究的目的:
- 评估EREFS评分系统对EoE的准确性.
- 为了比较 GI 临床医生在 EoE 图像分析中具有不同经验水平和多式联络LLM 的表现.
主要方法:
- 使用EREFS得分,对50个EoE患者的现实世界内镜图像进行了分级.
- 来自GI专家,研究员和三个LLM (ChatGPT-4o,Claude Sonnet 3.5,Perplexity Sonar) 的评分与评分进行了比较.
- 在LLM中,使用了单次射击和少次射击提示策略.
主要成果:
- 理工学研究员的整体准确率 (72.4%) 比专家 (65.3%) 和法学士 (58.9%) 高.
- 在检测方面,LLM的表现优于专家 (83.3%对49.3%),但在环评方面表现不佳 (30%对58%).
- 低射门促使LLM整体表现提高到62.7%,与专家 (65.3%) 相比.
结论:
- 在EREFS评分中,人类评分者和LLMs之间存在差异.
- 少数镜头提示是优化EoE图像分析中的LLM精度的有效策略.
相关概念视频
Endoscopic Procedures I: Esophagogastroduodenoscopy
820
An Esophagogastroduodenoscopy (EGD) is a diagnostic procedure in which an endoscopist uses a flexible, lighted endoscope to visualize the upper gastrointestinal (GI) tract. The procedure includes visualizing the oropharynx, esophagus, stomach, and the first part of the small intestine, the duodenum.
During an EGD, the endoscope can be used to:
During an EGD, the endoscope can be used to:
820
Ultrasound II: Endoscopic Ultrasound and FibroScan
506
Endoscopic Ultrasound (EUS) and FibroScan are valuable diagnostic tools in gastroenterology and hepatology, each with specific applications and techniques.
Endoscopic Ultrasound (EUS):
Endoscopic Ultrasound (EUS):
506
Endoscopic Studies I: Bronchoscopy and Thoracoscopy
495
Endoscopy is a non-surgical medical technique used to examine a person's internal organs and vessels. This lesson will focus on two types of endoscopic studies: bronchoscopy and thoracoscopy.
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
Bronchoscopy
Description
Bronchoscopy is a procedure that involves direct visualization of the larynx, trachea, and bronchi for diagnostic and therapeutic purposes. A flexible fiber optic or rigid bronchoscope is used to carry out the procedure. The fiber-optic bronchoscope is more frequently used due...
495
Gastroesophageal Reflux Disease II: Clinical Features and Management
662
Gastroesophageal reflux disease, or GERD, is a persistent medical condition that affects many individuals worldwide. Its clinical manifestations can vary greatly, making diagnosis and management challenging for healthcare professionals. The following is a comprehensive overview of the clinical manifestations, assessment, and management strategies for GERD.
Clinical Manifestations
GERD presents itself in a multitude of ways, with symptoms varying from person to person. The hallmark symptoms are...
Clinical Manifestations
GERD presents itself in a multitude of ways, with symptoms varying from person to person. The hallmark symptoms are...
662
Endoscopic Procedures III: Video Capsule Endoscopy
675
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
675
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
519
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
519


