以属性为导向的特征融合网络与知识启发的注意力机制,用于多源遥感分类.
Xiao Pan1, Changzhe Jiao1, Bo Yang1
1School of Artificial Intelligence, Xidian University, Xi'an 710119, China.
概括
本研究介绍了AFNKA,这是一个使用高光谱图像 (HSI) 和光检测和测距 (LiDAR) 数据进行土地利用和土地覆盖分类的新型网络. 通过有效地将多模式数据与知识启发的注意力机制融合起来,AFNKA提高了分类准确性.
科学领域:
- 遥感 遥感 遥感 遥感
- 地理空间分析的研究.
- 人工智能的人工智能
背景情况:
- 准确的土地使用和土地覆盖 (LULC) 分类对于环境监测和管理至关重要.
- 单模数据往往缺乏足够的信息来准确分类,特别是在复杂的环境中.
- 多模式数据,如高频谱图像 (HSI) 和光检测和距离测量 (LiDAR),提供了补充信息,以改善LULC分类.
研究的目的:
- 提出一个以属性为导向的特征融合网络与知识启发的注意力机制 (AFNKA),以改进多式联运LULC分类.
- 通过结合特定数据的知识来解决现有方法的局限性,例如HSI中的光谱混合物和LiDAR数据中的空间尺度.
- 通过考虑HSI (光谱) 和LiDAR (高度) 数据的独特物理属性来增强特征表示和融合.
主要方法:
- 开发一种以知识为灵感的注意力机制,从HSI和LiDAR数据中提取增强特征.
- 引入一种基于自适应性等位数估计器 (ACE) 的新型注意力模块来学习区分特征,利用HSI中的空间光谱相关性.
- 设计两个属性引导的融合模块,以选择性地聚合多模式特征,利用HSI的空间光谱特性和LiDAR的空间高度特性之间的相关性.
主要成果:
- 拟议的AFNKA网络在LULC分类任务中明显优于现有的最先进方法.
- 在多个多源数据集上的定量结果证明了属性引导的融合和知识启发的注意力机制的有效性.
- 该方法成功地利用了HSI和LiDAR数据的互补性质,以实现更准确的分类.
结论:
- 通过智能融合HSI和LiDAR数据,AFNKA提供了多模式LULC分类的卓越方法.
- 以知识为灵感的注意力和以属性为指导的融合策略有效地应对了光谱混合和不同空间尺度的挑战.
- 这项研究推进了遥感领域,为了解陆地表面特征提供了更强大,更准确的方法.
相关概念视频
01:21Association Areas of the Cortex
4.8K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.8K
01:22Force Classification
1.1K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.1K
01:30Classification of Signals
369
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
369
01:24Vision
52.8K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.8K
01:31Classification of Systems-II
132
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
132
01:26Classification of Systems-I
167
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
167