SASVi:任何手术视频都可以分类.
Ssharvien Kumar Sivakumar1, Yannik Frisch2,3, Amin Ranem4
1GRIS, TU Darmstadt, Fraunhoferstr. 5, 64283, Darmstadt, Germany. ssharvien_kumar.sivakumar@tu-darmstadt.de.
概括
我们开发了SASVi,这是使用基础模型进行手术视频细分的重新提示方法. 通过适应不断变化的场景,即使数据有限,SASVi也可以提高时间一致性.
科学领域:
- 计算机视觉 计算机视觉
- 医疗成像医学成像
- 人工智能的人工智能
背景情况:
- 基础模型需要针对特定领域的调整,用于诸如手术视频分割等任务.
- 现有的方法难以处理动态场景,即物体进入或离开视图.
研究的目的:
- 开发一种新的重新提示机制,以实现暂时一致的外科视频细分.
- 为了使基础模型能够对外科环境的特定语义进行概括.
主要方法:
- 提议SASVi,一个使用Overseer对象检测模型的重新提示机制.
- 在最小的目标域注释上训练了监督模型.
- 基于场景变化的基础模型SAM2的自动重新提示.
主要成果:
- 与框架智能的方法相比,SASVi在手术视频细分中的时间一致性至少提高了2.4%.
- 在多个数据集的外科视频上成功部署了SAM2.
- 在细分精度方面取得了定量和质量的改进.
结论:
- 萨斯维建立了一个新的基准,用于具有有限注释的时间一致的外科视频细分.
- 该方法有效地利用稀缺的数据来生成完整的视频注释.
- 公开发布的注释将支持未来的外科数据科学模型开发.
相关概念视频
Endoscopic Studies II: Thoracocentesis
Thoracentesis(Thoracocentesis), commonly known as pleural tap, is a medical procedure where a 22 gauge needle is inserted into the pleural space, the area between the lung and chest wall. This procedure is commonly performed to diagnose or treat various respiratory disorders.
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
Description
Excess pleural fluid or air may accumulate in some respiratory disorders in the thoracic cavity. To treat pleural effusion, a physician conducts thoracentesis by carefully piercing the chest wall and entering...
Endoscopic Procedures II: Colonoscopy
The colon, or large intestine, is the final segment of the digestive system. Its primary functions include absorbing water and vitamins produced by gut bacteria and transforming waste from liquid to solid to form stool. In adults, the large intestine is approximately 5 feet long and consists of four main sections:
Endoscopic Procedures III: Video Capsule Endoscopy
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers, unexplained...
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Endoscopic Procedures V: ERCP
Endoscopic Retrograde Cholangiopancreatography (ERCP) is a diagnostic procedure that combines endoscopy and fluoroscopy to diagnose and treat conditions related to the bile ducts, pancreatic ducts, and gallbladder. This procedure is beneficial for identifying and addressing blockages, gallstones, strictures, and tumors within the biliary or pancreatic systems. ERCP is both diagnostic and therapeutic, offering the ability to visualize and treat identified problems in one session.
Patient...
Patient...
Urinary Tract Calculi VI: Surgical Management
Procedures for Kidney StonesMedical intervention is necessary when kidney stones or renal calculi are too large to pass spontaneously (typically greater than 5 millimeters) when stones are accompanied by symptomatic infection (such as fever or pyelonephritis), when they impair kidney function, or when they cause persistent symptoms like severe pain, nausea, or urinary retention. Additionally, patients with only one kidney or those who cannot be treated with medical management also require...


