PitVis-2023挑战:在内镜垂体外科手术视频中的工作流识别
Adrito Das1, Danyal Z Khan2, Dimitrios Psychogyios1
1UCL Hawkes Institute, University College London, London, UK.
Medical image analysis
|August 6, 2025
概括
计算机视觉模型准确地识别了内镜下垂体手术视频中的手术步骤和仪器. 先进的深度学习,特别是变压器架构,对改善外科培训和实时辅助有希望.
科学领域:
- 计算机视觉 计算机视觉
- 医疗成像医学成像
- 外科手术工作流程分析
背景情况:
- 计算机视觉在微创手术 (MIS) 视频分析中的应用正在扩大.
- 在MIS中的工作流识别通过识别手术步骤和仪器来帮助外科培训和实时协助.
- 内镜垂体外科手术由于工作空间有限和频繁的程序/仪器变化而带来独特的挑战.
研究的目的:
- 评估内镜垂体外科手术视频中手术步骤和仪器识别的最新计算机视觉模型.
- 为了对脏视野 (PitVis) 2023挑战数据集的模型性能进行比较.
- 评估先进的深度学习模型对这一具有挑战性的外科领域的可转移性.
主要方法:
- 在PitVis 2023挑战提供了25个内镜下垂体手术视频进行分析.
- 参与者利用各种深度学习模型进行自动化手术步骤和仪器识别.
- 顶级模型包含基于变压器的架构,带有自动回归解码器或时空编码器.
主要成果:
- 来自9个国际团队的18个作品参加了比赛,并在MICCAI-2023.3上展示了结果.
- 基于变压器的模型与自动回归解码器在步骤识别方面表现出色.
- 采用空间和时间编码器的模型,特别是2层时间架构,导致仪器识别.
- 这两种顶级模型都超过了纯粹的空间方法,突出了顺序和时间数据的意义.
结论:
- 最先进的计算机视觉模型是可转移的,并且对于分析内镜下垂体手术视频的挑战性任务是有效的.
- 这些发现强调了手术视频分析中顺序和时间信息处理的重要性.
- 皮特维斯2023挑战数据集和基准结果推动了MIS计算机视觉领域的发展.
相关概念视频
Endoscopic Procedures III: Video Capsule Endoscopy
331
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
331
Endoscopic Procedures V: ERCP
916
Endoscopic Retrograde Cholangiopancreatography (ERCP) is a diagnostic procedure that combines endoscopy and fluoroscopy to diagnose and treat conditions related to the bile ducts, pancreatic ducts, and gallbladder. This procedure is beneficial for identifying and addressing blockages, gallstones, strictures, and tumors within the biliary or pancreatic systems. ERCP is both diagnostic and therapeutic, offering the ability to visualize and treat identified problems in one session.
Patient...
Patient...
916
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
175
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
175


