通过光谱可视化和深度学习提高肠胃疾病的早期检测
Tsung-Jung Tsai1, Kun-Hua Lee2, Chu-Kuang Chou1,3
1Division of Gastroenterology and Hepatology, Department of Internal Medicine, Ditmanson Medical Foundation Chia-Yi Christian Hospital, Chia-Yi 60002, Taiwan.
Bioengineering (Basel, Switzerland)
|August 28, 2025
概括
这项研究介绍了光谱辅助视觉增强器 (SAVE),这是一种将标准内镜图像转换为高光谱和窄带成像的软件工具. 在没有新的硬件的情况下改善了胃肠疾病的检测.
科学领域:
- 医学成像
- 胃肠病学
- 计算机视觉
背景情况:
- 通过内镜诊断胃肠道疾病是传统白光成像 (WLI) 的限制.
- 由于对比度和灵敏度较低,早期检测粘膜异常具有挑战性.
- 像高光谱成像 (HSI) 这样的先进成像技术具有潜力,但需要专门的硬件.
研究的目的:
- 开发和验证一个软件驱动的框架,频谱辅助视觉增强器 (SAVE).
- 在没有硬件修改的情况下将标准WLI转换为HSI和模拟窄带成像 (NBI).
- 为了提高胃肠道疾病的诊断性能.
主要方法:
- 使用的光谱重建技术:麦克白色检查器校准,主要组件分析 (PCA) 和多变量多项式回归.
- 达到0.056的RMSE和SSIM>90%的高保真度
- 在Kvasir v2数据集上训练并验证深度学习模型 (ResNet,EfficientNet) (6490张图像).
主要成果:
- 在精度,回忆和F1得分方面,SAVE增强的图像始终优于原始WLI.
- 在地理标志条件下,EfficientNet-B2和EfficientNetV2-B0模型实现了最高的分类准确性.
- 在没有专门的成像硬件的情况下,显著改善了诊断性能.
结论:
- SAVE是一款用于增强胃肠道诊断的创新软件解决方案.
- 它有可能显著提高胃肠道疾病的早期检测率.
- SAVE可以简化临床工作流程,并扩大对先进成像的访问,特别是在资源有限的环境中.
相关概念视频
Imaging Studies III: Gastrointestinal Motility Studies and Virtual Colonoscopy
142
This lesson explores three gastrointestinal imaging techniques: radionuclide testing, colonic transit studies, and virtual colonoscopy.
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
142
Endoscopic Procedures III: Video Capsule Endoscopy
329
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
329
Endoscopic Procedures I: Esophagogastroduodenoscopy
346
An Esophagogastroduodenoscopy (EGD) is a diagnostic procedure in which an endoscopist uses a flexible, lighted endoscope to visualize the upper gastrointestinal (GI) tract. The procedure includes visualizing the oropharynx, esophagus, stomach, and the first part of the small intestine, the duodenum.
During an EGD, the endoscope can be used to:
During an EGD, the endoscope can be used to:
346


