SIFusion:基于语义注入的轻量级红外和可见图像融合
Song Qian1, Liwei Yang1, Yan Xue1
1Faculty of Information Engineering, Xinjiang Institute of Technology, Aksu, China.
PloS one
|November 6, 2024
概括
本研究介绍了SIFusion,这是一种轻量级的图像融合方法,可以增强机器视觉任务的视觉吸引力和语义理解. 它有效地整合了红外和可见光图像,在复杂的场景中提高了性能.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 图像处理 图像处理
背景情况:
- 传统的图像融合方法优先考虑人类的视觉感知,经常忽视对于高级机器视觉任务至关重要的语义信息.
- 现有的融合技术,包括下游任务,往往是复杂和计算要求高,限制了实际的可用性.
- 需要高效和有效的图像融合方法,以满足人类和机器视觉的要求,特别是语义理解.
研究的目的:
- 提出一种新的,轻量级的图像融合方法,SIFusion,解决现有方法的局限性.
- 为了增强融合图像的视觉吸引力和语义信息提取,用于高级视觉任务.
- 开发一个适合实际应用的计算效率高的融合网络.
主要方法:
- 开发了SIFusion,一种基于语义注入的轻量级红外和可见光图像融合方法.
- 整合了一个语义意识的分支来提取语义特征和一个语义注入模块 (SIM) 来整合它们.
- 引入了一个边缘卷积模块 (ECB),利用结构重组参数化来提高编码器-解码器表示能力并降低网络复杂性.
主要成果:
- 在视觉吸引力和高级语义提取方面,SIFusion表现出色.
- 该方法为随后的高水平视觉任务提供了令人满意的融合结果,即使在具有挑战性的环境中也是如此.
- 实验性比较证实了拟议方法在现有技术上的优越性.
结论:
- SIFusion为红外和可见光图像融合提供了有效和高效的解决方案,平衡视觉质量与语义信息.
- 语义注入方法和轻量级网络设计使SIFusion适用于需要高水平视觉任务处理的实际应用.
- 拟议的方法通过解决机器视觉中对语义意识的关键需求,推动了图像融合领域的发展.
更多相关视频
10:30Simultaneously Capturing Real-time Images in Two Emission Channels Using a Dual Camera Emission Splitting System: Applications to Cell Adhesion
Published on: September 4, 2013
9.6K
04:48Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
Published on: November 30, 2022
2.7K
相关概念视频
01:37Super-resolution Fluorescence Microscopy
6.9K
Super-resolution fluorescence microscopy (SRFM) provides a better resolution than conventional fluorescence microscopy by reducing the point spread function (PSF). PSF is the light intensity distribution from a point that causes it to appear blurred. Due to PSF, each fluorescing point appears bigger than its actual size, and it is the PSF interference of nearby fluorophores that causes the blurred image. Various approaches to achieving higher resolution through SRFM have recently been...
6.9K
01:12Immunofluorescence Microscopy
9.9K
A fluorescence microscope uses fluorescent chromophores called fluorochromes, which can absorb energy from a light source and then emit this energy as visible light. Fluorochromes include naturally fluorescent substances (such as chlorophylls) and fluorescent stains that are added to the specimen to create contrast. Dyes such as Texas red and FITC are examples of fluorochromes. Other examples include the nucleic acid dyes 4’,6’-diamidino-2-phenylindole (DAPI), and acridine orange.
9.9K
01:16Confocal Fluorescence Microscopy
13.1K
Confocal microscopy is an advanced microscopic technique. The prime advantage of the confocal microscope over other microscopy techniques is its ability to block the out-of-focus light from the illuminated samples using pinholes. It is widely used with fluorescence optics to obtain high-resolution, sharp contrast images. Unlike optical microscopes, confocal microscopes use a focused beam of light laser to scan the entire sample surface at different z-planes. These microscopes are, therefore,...
13.1K