无人机图像实时语义细分与全球-本地信息注意力
1School of Geosciences, Yangtze University, Wuhan 430100, China.
Sensors (Basel, Switzerland)
|April 28, 2025
概括
本研究引入了一种用于无人机图像实时语义细分的新方法,增强全球和本地信息集成. 与现有的轻量级算法相比,新方法显著提高了准确性和速度.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 遥感 遥感 遥感 遥感
背景情况:
- 在无人机图像中实时语义细分的轻量级算法往往无法有效地整合全球和本地图像信息.
- 这种缺陷导致错误检测和错误分类,阻碍了关键应用中的性能.
研究的目的:
- 提出一种用于无人机图像实时语义细分的新方法,以增强多层次全球上下文信息的整合.
- 与现有的轻量级模型相比,提高精度和实时处理能力.
主要方法:
- 使用了一个UNet结构与一个Resnet18编码器用于特征提取.
- 在解码器中集成了一个全球-本地注意模块,以合并全球和本地图像信息.
- 在分割头中使用浅特征融合模块进行多尺度特征集成.
主要成果:
- 在UAvid数据集上达到68%的mIoU,在UDD6数据集上达到67%的mIoU,分别超过了UNet的基线10%和21.2%.
- 达到了72.4/秒的实时处理速度,比基线UNet.快54.4/秒.
- 在准确性和实时处理速度之间表现出平衡的性能.
结论:
- 拟议的方法有效地整合了多个规模的全球背景和本地信息,以增强实时语义细分.
- 该模型显著提高了准确性,并实现了高处理速度,使其适合于苛刻的无人机图像应用程序.
相关概念视频
Design Example: Identifying the Locations of Monuments in the Field Using Global Positioning System Device
Surveyors use Global Positioning System (GPS) technology to measure the precise location and elevation of points on Earth. In a recent survey, GPS receivers were used to determine the coordinates and elevations of two park monuments. The process involved careful mission planning, data collection, and correction to ensure accuracy. The survey began with mission planning to identify optimal satellite visibility and minimize Position Dilution of Precision (PDOP). A geodetic control point served as...
Application of Linearization and Approximation
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...


