多模式图像融合用于智能运输中增强的车辆识别
Naif Al Mudawi1, Muhammad Waqas Ahmed2, Haifa F Alhasson3
1Department of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi Arabia.
PeerJ. Computer science
|November 10, 2025
概括
这项研究引入了一种新的深度学习方法,用于增强空中图像分析,改进目标检测和分类. 该方法融合多模式数据,在遥感应用中提供卓越的性能.
科学领域:
- 遥感和地理空间分析
- 计算机视觉和深度学习
- 人工智能在监控中的作用
背景情况:
- 深度学习方法已经推进了单模式空中图像处理.
- 多模式数据集成 (例如红外,LiDAR) 显著提高了遥感中的检测性能.
- 现有的方法需要改进,以便在现实世界中进行可靠的目标检测.
研究的目的:
- 提出一种新的深度学习方法,用于在航空图像中增强特征表示.
- 通过多模式数据融合来提高对象检测和分类准确性.
- 为执法和搜救等应用提升目标检测能力.
主要方法:
- 一个基于深度学习的注意力机制从空中图像生成深度地图,与RGB数据融合.
- 图像细分使用马尔科夫随机场 (MRF);对象检测使用你只看一次 (YOLOv4) 框架.
- 混合特征提取在视觉变压器 (ViT) 中结合了面向梯度 (HOG) 和二进制稳定不变可扩展关键点 (BRISK) 的历史图,其次是剩余网络 (ResNet-18) 分类.
主要成果:
- 实现了高精度得分:98.4%在圆形天线上,96.2%在AU-Air上,97.4%在车辆空中图像数据集 (VAID) 上进行物体检测.
- 与现有的车辆检测和分类最先进的方法相比,证明了卓越的性能.
- 建议将深度图和RGB图像与先进的特征提取相结合,大大提高了检测准确度.
结论:
- 这种新的方法有效地整合了使用深度学习进行优质目标检测的多模式空中图像.
- 混合特征提取和融合战略在具有挑战性的遥感场景中显著提高了性能.
- 这种方法为需要准确和高效的空中监视的关键应用提供了强大的解决方案.
相关概念视频
Imaging Studies VII: Vascular Imaging
297
DefinitionRenal angiography, also known as renal arteriography, is an imaging technique used to obtain a comprehensive view of blood flow and the vascular structure of blood vessels in the kidneys and surrounding areas.PurposeRenal angiography detects blood vessel abnormalities in the kidneys, such as aneurysms, stenosis, thrombosis, vascular tumors, and renal artery stenosis. It evaluates kidney function and guides interventional treatments like angioplasty or stent placement.Pre-Procedure...
297
Design Example: Identifying the Locations of Monuments in the Field Using Global Positioning System Device
376
Surveyors use Global Positioning System (GPS) technology to measure the precise location and elevation of points on Earth. In a recent survey, GPS receivers were used to determine the coordinates and elevations of two park monuments. The process involved careful mission planning, data collection, and correction to ensure accuracy. The survey began with mission planning to identify optimal satellite visibility and minimize Position Dilution of Precision (PDOP). A geodetic control point...
376
Imaging Studies for Cardiovascular System V: CT
268
Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
268
