自主监督的学习框架,用于使用借口任务对内镜图像进行有效的分类.
Shima Ayyoubi Nezhad1, Golnaz Tajeddin1, Toktam Khatibi1
1School of Industrial and Systems Engineering, Tarbiat Modares University (TMU), Tehran, Iran.
PloS one
|May 9, 2025
概括
本研究介绍了一种自我监督学习 (SSL) 框架,用于识别内镜图像中的解剖学地标. 这种新方法显著提高了使用未标记数据对胃肠道区域的分类准确性.
科学领域:
- 医疗成像医学成像
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 在内镜视频中准确识别解剖学标志对于诊断胃肠道疾病至关重要.
- 挑战包括视觉变化和有限的注释数据,阻碍了传统的机器学习方法.
研究的目的:
- 开发一种新的自主监督学习 (SSL) 框架,用于从未标记的内镜图像中增强特征学习.
- 提高关键胃肠道解剖区域 (Z线,食道,腹腔/腹腔) 的分类准确度.
- 通过注意力机制,变压器和Grad-CAM可视化来增强模型的解释性.
主要方法:
- 一个自主监督学习 (SSL) 框架,集成着色化,拼图解和补丁预测借口任务.
- 整合了注意力机制和基于变压器的架构,以实现强大的特征提取.
- 利用Grad-CAM可视化影响模型决策的关键区域.
主要成果:
- 在Z线,食道和/骨柱区域实现了98%的分类准确度.
- 与传统模型相比,在精度,回忆和F1得分方面取得了显著的改进.
- 通过ROC曲线和混矩阵验证有效性,突出所有类别的高性能.
结论:
- 拟议的SSL框架有效地提高了内镜解剖标志识别的特征学习和分类准确性.
- 注意,变压器和Grad-CAM的整合提供了一个可扩展,可解释和临床适用的解决方案.
- 这种方法减少了对大量注释数据集的依赖,推进了医学图像分析.
相关概念视频
01:29Endoscopic Procedures I: Esophagogastroduodenoscopy
36
An Esophagogastroduodenoscopy (EGD) is a diagnostic procedure in which an endoscopist uses a flexible, lighted endoscope to visualize the upper gastrointestinal (GI) tract. The procedure includes visualizing the oropharynx, esophagus, stomach, and the first part of the small intestine, the duodenum.
During an EGD, the endoscope can be used to:
During an EGD, the endoscope can be used to:
36
01:25Endoscopic Procedures II: Colonoscopy
34
The colon, or large intestine, is the final segment of the digestive system. Its primary functions include absorbing water and vitamins produced by gut bacteria and transforming waste from liquid to solid to form stool. In adults, the large intestine is approximately 5 feet long and consists of four main sections:
34
01:28Endoscopic Procedures III: Video Capsule Endoscopy
51
Capsule endoscopy, or wireless or video capsule endoscopy, is a diagnostic procedure for examining the entire gastrointestinal tract. Patients swallow a capsule about the size of a vitamin tablet. The capsule is equipped with a transmitter, a battery, an LED light source, and a color video camera to capture images throughout the gastrointestinal tract. This procedure is particularly useful for diagnosing conditions such as Crohn's disease, ulcerative colitis, tumors, polyps, ulcers,...
51
01:26Endoscopic Procedures V: ERCP
40
Endoscopic Retrograde Cholangiopancreatography (ERCP) is a diagnostic procedure that combines endoscopy and fluoroscopy to diagnose and treat conditions related to the bile ducts, pancreatic ducts, and gallbladder. This procedure is beneficial for identifying and addressing blockages, gallstones, strictures, and tumors within the biliary or pancreatic systems. ERCP is both diagnostic and therapeutic, offering the ability to visualize and treat identified problems in one session.
Patient...
Patient...
40
01:26Endoscopic Procedures IV: Sigmoidoscopy and Laproscopy
31
Sigmoidoscopy and laparoscopy are distinct medical procedures that enable physicians to internally inspect different parts of the GI tract. Although they serve different purposes, each is essential for diagnosing and, in some cases, treating various medical conditions.
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
Sigmoidoscopy
Sigmoidoscopy is a diagnostic procedure that uses a flexible sigmoidoscope equipped with a light source and camera to examine the rectum and sigmoid colon. The procedure involves inserting the tube through the anus...
31
01:25Ultrasound II: Endoscopic Ultrasound and FibroScan
54
Endoscopic Ultrasound (EUS) and FibroScan are valuable diagnostic tools in gastroenterology and hepatology, each with specific applications and techniques.
Endoscopic Ultrasound (EUS):
Endoscopic Ultrasound (EUS):
54