利用具有动态令牌化的清晰注意力变压器的潜力,用于高光谱图像分类
Dhirendra Prasad Yadav1,2, Deepak Kumar2, Anand Singh Jalal3
1Department of Computer Engineering & Applications, G.L.A. University, Mathurar, Uttar Pradesh, India.
PloS one
|August 4, 2025
概括
一个新的Limpid Size Attention Network (LSANet) 通过改善空间-光谱特征相关性来增强高光谱图像分析. 这种深度学习模型在远程传感应用中比传统的CNN和视觉转换器提供了更高的准确性.
科学领域:
- 遥感 遥感 遥感 遥感
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 超光谱成像 (HSI) 提供了丰富的光谱信息,但在空间光谱特征提取方面面临挑战.
- 卷积神经网络 (CNN) 在上下文建模方面表现出色,但在HSI中与全球空间光谱相关性作斗争.
- 视觉转换器 (ViT) 提供全球上下文,但可能是计算密集型,需要有效的位置编码.
研究的目的:
- 提出一种新的深度学习架构,即Limpid Size Attention Network (LSANet),用于增强的高光谱图像分析.
- 改进HSI中的空间和光谱特征的提取和表示.
- 开发一个计算高效的注意力机制,以捕捉全球空间-光谱特征相关性.
主要方法:
- LSANet集成了3D和2D卷积块,以增强空间光谱特征表示.
- 引入了一个新的Limpid Attention Block (LAB),利用LS的注意力来实现全球空间-光谱特征相关性.
- 条件位置编码 (CPE) 在ViT编码器中用于动态生成令牌,以实现更丰富的上下文表示.
主要成果:
- 在基准HSI数据集上,LSANet实现了高整体准确性 (OA):98.78% (IP),98.67% (PU),97.52% (SV) 和89.45% (博茨瓦纳).
- 与现有的CNN和基于变压器的方法相比,拟议的模型表现出更高的性能.
- 与MHSA相比,LSANet有效地捕获了全球空间光谱特征相关性,并降低了计算成本.
结论:
- 通过有效地整合空间和光谱信息,LSANet在高光谱图像分类方面取得了重大进展.
- 拟议的LS注意力机制为捕捉HSI数据中的全球依赖提供了一个有效的替代方案.
- 对于各种需要高精度HSI分析的遥感应用,LSANet提供了一个有前途的深度学习方法.
相关概念视频
Transformers
1.2K
A device that transforms voltages from one value to another using induction is called a transformer. A transformer consists of two separate coils, or windings, wrapped around the same soft iron core. However, they are electrically insulated from each other.
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
The iron core has a substantial relative permeability. Therefore, the magnetic field lines generated due to the current in one winding are almost entirely confined within the core, such that the same magnetic flux permeates each turn of both...
1.2K
Force Classification
1.6K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.6K
Aggregates Classification
384
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
384
Light Acquisition
8.6K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.6K
Classification of Signals
894
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
894
Types Of Transformers
1.1K
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
1.1K


