通过随机全球照明增强进行可泛化多片细分
IEEE journal of biomedical and health informatics
|February 20, 2024
概括
本研究介绍了一种照明增强方法,以改善结肠镜图像中的多片细分,解决域移动问题. 这种新方法增强了对未见的数据集的模型概括性,提高了结直肠癌的诊断准确性.
科学领域:
- 医疗成像医学成像
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 在结肠镜检查中精确的聚细分对于结肠直肠癌的诊断至关重要.
- 聚细分的深度学习模型面临着域转移的挑战,降低了新数据集的性能.
研究的目的:
- 开发一种基于照明增强的域概括方法,用于聚合物细分.
- 提高深度学习模型对未见的结肠镜图像数据集的概括能力.
主要方法:
- 提出了一个图像分解模块 (IDM) 来将图像分成反射率和照明组件.
- 引入了一个照明转换模块 (ITM) 用于用合成的全球照明地图来增强图像.
- 开发了一种照明差异不敏感度 (IViSen) 度量来评估模型的稳定性.
主要成果:
- 拟议的方法在四个结肠镜数据集 (CVC-ClinicDB,CVC-ColonDB,ETIS-Larib,Kvasir-SEG) 的未见域上显示出卓越的性能.
- 实现了60.82%的Dice和53.19%的IoU的平均值,比竞争方法提高了分别2.06%和2.31%.
- 该IViSen指标与模型通用性有很好的相关性.
结论:
- 照明增强是一种有效的策略,用于解决聚合物细分的域转移.
- 拟议的方法显著提高了结肠镜图像分析的深度学习模型的稳定性和通用性.
- 这项工作为提高自动化多体检测和结直肠癌查提供了一个有希望的方向.
相关概念视频
02:16Light Acquisition
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
01:37Super-resolution Fluorescence Microscopy
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been developed.