ColonCrafter:使用扩散前置的结肠镜视频的深度估计模型
Romain Hardy1, Tyler M Berzin2, Pranav Rajpurkar1
1Department of Biomedical Informatics, Harvard Medical School, USA.
Pacific Symposium on Biocomputing. Pacific Symposium on Biocomputing
|February 27, 2026
概括
新的人工智能模型ColonCrafter从结肠镜视频中生成准确的深度图,用于3D重建. 它确保了时间的一致性,改善了内镜中3D场景的理解.
科学领域:
- 医疗成像医学成像
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 在结肠镜检查中,准确的3D场景理解至关重要,但具有挑战性.
- 现有的深度估计模型缺乏3D重建的时间一致性.
研究的目的:
- 为单眼结肠镜视频开发一个时间一致的深度估计模型.
- 在内镜手术中实现强大的3D场景理解和重建.
主要方法:
- 开发了基于扩散的深度估计模型ColonCrafter.
- 利用合成结肠镜序列来学习几何先验.
- 实施了一种风格转移技术,用于对临床视频进行域调整.
主要成果:
- 在C3VD数据集上,ColonCrafter实现了最先进的零射击性能.
- 与通用和内镜特定方法相比,证明了更高的性能.
- 展示了临床相关的应用,如3D点云生成和表面覆盖率评估.
结论:
- ColonCrafter为结肠镜检查提供暂时一致的深度图.
- 该模型为内镜中3D重建提供了重大进展.
- 未来的工作可能会解决全轨道3D重建的挑战.
相关概念视频
Imaging Studies III: Gastrointestinal Motility Studies and Virtual Colonoscopy
512
This lesson explores three gastrointestinal imaging techniques: radionuclide testing, colonic transit studies, and virtual colonoscopy.
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
512
Endoscopic Procedures II: Colonoscopy
910
The colon, or large intestine, is the final segment of the digestive system. Its primary functions include absorbing water and vitamins produced by gut bacteria and transforming waste from liquid to solid to form stool. In adults, the large intestine is approximately 5 feet long and consists of four main sections:
910
Uniform Depth Channel Flow: Problem Solving
560
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
560
Uniform Depth Channel Flow
680
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
680
Endoscopic Procedures III: Video Capsule Endoscopy
1.0K
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
1.0K
Assessment of Diffusion and Perfusion
1.9K
Understanding and evaluating diffusion and perfusion is critical in assessing a patient's respiratory and circulatory health. These processes play key roles in maintaining the body's internal environment, ensuring that tissues receive adequate oxygen while waste products are efficiently removed.
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
The Role of Diffusion in Respiration
Diffusion is the process by which molecules move from an area of higher concentration to an area of lower concentration. In the respiratory system, this...
1.9K


