空中IRGAN:未配对的空中可见到红外图像转换与双编码器结构
Decao Ma1, Juan Su2, Shaopeng Li1,3
1Xi'an Research Institute of High Technology, 710025, Xi'an, China.
Scientific reports
|September 27, 2024
概括
这项研究介绍了AerialIRGAN,这是一种用于从可见光图像中生成空中红外图像的新算法,没有配对数据. 它克服了现有方法的局限性,产生更高质量的红外图像,以便更好地分析目标.
科学领域:
- 计算机视觉 计算机视觉
- 遥感 遥感 遥感 遥感
- 人工智能的人工智能
背景情况:
- 由于设备和环境限制,获得空中红外图像是昂贵和困难的.
- 现有的可见到红外图像转换方法通常需要注册数据,并与复杂的空中场景作斗争.
研究的目的:
- 开发一个端到端,未配对的空中可见到红外图像翻译算法.
- 解决当前方法在生成现实的红外图像来自各种空中可见光数据的局限性.
主要方法:
- 拟议的AerialIRGAN算法采用双编码器结构,结合了SegmentAnything模型和UniRepLKNet.
- 通过桥梁模块集成语义和细粒度特征.
- 实现结构外观的一致性损失,以实现现实的红外图像合成.
主要成果:
- 与现有的算法相比,AerialIRGAN成功生成了更高质量的红外图像.
- 该方法在主观视觉评估和客观指标评估中都表现出卓越的表现.
- 成功地将未配对的空中可见图像转换为红外域.
结论:
- AerialIRGAN为未配对的空中可见到红外图像转换提供了有效的解决方案.
- 拟议的方法提高了获得特定空中红外目标的可行性.
- 这一进步对遥感和目标检测应用有影响.
更多相关视频
10:30Simultaneously Capturing Real-time Images in Two Emission Channels Using a Dual Camera Emission Splitting System: Applications to Cell Adhesion
Published on: September 4, 2013
9.6K
06:25Time Multiplexing Super Resolving Technique for Imaging from a Moving Platform
Published on: February 12, 2014
8.4K
相关概念视频
Infrared (IR) Spectroscopy: Overview
1.5K
When electromagnetic radiation passes through a material, atoms or molecules transition from a lower to a higher energy state by absorbing radiation corresponding to the energy difference between the two states. The absorption of infrared (IR) radiation causes transitions between vibrational energy levels in a molecule. Therefore, IR spectroscopy is a useful analytical tool for determining the molecular structure of molecules.
Different compounds display unique properties due to their...
Different compounds display unique properties due to their...
1.5K
Deconvolution
138
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
138
Relative Motion Analysis using Rotating Axes
449
Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it...
449
Distance Measurements by Taping
30
Tapes are essential in surveying for accurate, durable, and short-distance measurements. Made from lightweight, nylon-coated steel, they offer flexibility and strength for rugged outdoor use. The nylon coating protects against rust and wear, extending the tape's life. Standard lengths, around 30 meters, are marked in meters and millimeters for precision.Surveyors select tapes based on site conditions and accuracy needs. Lightweight, nylon-coated tapes are commonly used for ease of handling and...
30
IR Frequency Region: X–H Stretching
918
In IR spectroscopy, signals produced by the X−H bonds (such as C−H, O−H, or N−H) can be observed in the frequency range of 2700–4000 cm–1. The C−H stretching vibration forms sharp bands in the region 2850–3000 cm–1. The presence of the O−H stretching vibration leads to the forming of an absorption band in the frequency range 3650–3200 cm−1. At the same time, N−H stretching can be confirmed by absorption bands in...
918
Depth Perception and Spatial Vision
602
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
602
