在无人机遥感图像中用于多尺度物体检测的纹理重建低采样
Wenhao Zheng1,2, Bangshu Xiong1,2, Jiujiu Chen1,2
1The School of Information Engineering, Nanchang Hangkong University, Nanchang 330063, China.
Sensors (Basel, Switzerland)
|March 17, 2025
概括
这项研究引入了一种纹理重构下面采样 (TRD) 模块,以改善无人机 (UAV) 图像中的物体检测. 在降低采样过程中,TRD重建了丢失的纹理特征,提高了多尺度物体检测的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 遥感 遥感 遥感 遥感
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 无人驾驶飞行器 (UAV) 遥感图像对物体检测构成挑战,原因在于缩放采样过程中的尺度变化和特征损失.
- 现有的深度网络在采用多层下采样时,在多层物体检测任务中经常会丢失关键的纹理信息.
研究的目的:
- 解决无人机遥感图像中纹理特征损失造成的多尺度物体检测性能下降的问题.
- 提出一种新的,轻量级的纹理重构下面采样 (TRD) 模块,旨在减轻下面采样过程中的特征损失.
主要方法:
- 提出了一种轻量级的纹理重构下面采样 (TRD) 模块,该模块将丢失的纹理特征作为剩余信息.
- 在TRD内部实施级联下采样和上采样运营商,为特征地图重建提供剩余反.
- 在骨干网络中用TRD模块进行评估,取代现有的下方采样模块.
主要成果:
- 与基线相比,TRD模块在NWPU VHR-10数据集上的平均精度 (AP) 提高了3.1%.
- 在VisDrone-DET数据集中,TRD提高了AP的3.2%,小 (APS),中 (APM) 和大 (APL) 对象的AP显著改善,分别为3.1%,8.8%和13.9%.
- 在降低样本采集后,TRD以最小的额外计算成本展示了丰富的特征信息.
结论:
- 拟议的TRD模块有效地重建丢失的纹理特征,增强后续视觉任务的辨别能力.
- 在具有挑战性的无人机遥感图像数据集中,TRD显著提高了多尺度物体检测的准确性.
- TRD的轻量级设计为改善远程传感应用深度网络的特征提取提供了有效的解决方案.
相关概念视频
01:20Downsampling
872
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
872
01:22Upsampling
745
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
745