相关实验视频
Updated: Jun 4, 2025

13:19
Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
9.0K
使用Resnet50*基于可解释的深度特征工程模型与内镜图像的胃肠道疾病的自动检测
Veysel Yusuf Cambay1,2, Prabal Datta Barua3, Abdul Hafeez Baig4
1Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig 23119, Türkiye.
Sensors (Basel, Switzerland)
|December 17, 2024
概括
一个新的ResNet50*模型有效地从内镜图像中检测出胃肠道疾病. 这种深度特征工程方法实现了超过92%的准确性,证明了其改善诊断的潜力.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 胃肠病学 胃肠病学
背景情况:
- 胃肠道疾病的诊断严重依赖于内镜成像.
- 准确和早期发现胃肠道疾病对于有效治疗至关重要.
- 当前的诊断方法可能受到人类解释和变化的限制.
研究的目的:
- 开发一个新的卷积神经网络 (CNN),ResNet50*,用于检测胃肠道疾病.
- 创建一个可解释的深度特征工程 (DFE) 模型,与ResNet50*集成,以增强诊断能力.
- 在多个内镜图像数据集中评估拟议的ResNet50*模型的性能和通用性.
主要方法:
- 开发ResNet50*,一种具有剩余块和基于聚合的注意力机制的CNN变体.
- 实施一个四个阶段的DFE模型:特征提取,代特征选择,浅层分类 (kNN,SVM) 和信息融合.
- 使用梯度加权类激活映射 (Grad-CAM) 进行特征可视化和选择.
- 在增强Kvasir,Kvasir版本2和无线囊内镜 (WCE) 数据集上训练并验证了模型.
主要成果:
- 在所有测试的数据集上,ResNet50*模型实现了超过92%的分类准确性.
- 在无线囊内镜 (WCE) 数据集中记录了99.13%的显著准确率.
- DFE模型产生了14个不同的结果,最终的决定是根据贪的算法准确性进行选择的.
- 在多种不同的内镜图像数据集中一致的性能证实了模型的概括性.
结论:
- 拟议的ResNet50*模型显示了胃肠道疾病的优越分类性能.
- 可解释的DFE模型提高了诊断准确性,并提供了可解释的结果.
- 开发的架构显示了在临床实践中改善胃肠道疾病自动检测的巨大潜力.
相关概念视频
Endoscopic Procedures I: Esophagogastroduodenoscopy
66
An Esophagogastroduodenoscopy (EGD) is a diagnostic procedure in which an endoscopist uses a flexible, lighted endoscope to visualize the upper gastrointestinal (GI) tract. The procedure includes visualizing the oropharynx, esophagus, stomach, and the first part of the small intestine, the duodenum.
During an EGD, the endoscope can be used to:
During an EGD, the endoscope can be used to:
66
Imaging Studies III: Gastrointestinal Motility Studies and Virtual Colonoscopy
49
This lesson explores three gastrointestinal imaging techniques: radionuclide testing, colonic transit studies, and virtual colonoscopy.
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
Radionuclide Testing
Radionuclide testing is a sophisticated medical technique for assessing gastrointestinal motility. It focuses on gastric emptying and colonic transit time. Radioactive markers track the movement of food through the digestive system, providing insights into gastrointestinal disorders.
In gastric emptying studies, a meal's liquid and...
49
Endoscopic Procedures III: Video Capsule Endoscopy
75
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
75
Endoscopic Procedures II: Colonoscopy
56
The colon, or large intestine, is the final segment of the digestive system. Its primary functions include absorbing water and vitamins produced by gut bacteria and transforming waste from liquid to solid to form stool. In adults, the large intestine is approximately 5 feet long and consists of four main sections:
56
Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
48
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
48
Ultrasound II: Endoscopic Ultrasound and FibroScan
77
Endoscopic Ultrasound (EUS) and FibroScan are valuable diagnostic tools in gastroenterology and hepatology, each with specific applications and techniques.
Endoscopic Ultrasound (EUS):
Endoscopic Ultrasound (EUS):
77

