SGLFormer:具有高性能的全球-本地融合变压器
Han Zhang1,2, Chenlin Zhou1, Liutao Yu1
1AI Department, Peng Cheng Laboratory, Shenzhen, China.
Frontiers in neuroscience
|March 29, 2024
概括
本研究介绍了Spiking全球局部融合变压器 (SGLFormer),这是一个新的Spiking神经网络架构,可以显著提高计算机视觉任务的性能. 通过整合变压器和卷积结构,改善梯度反向传播,SGLFormer实现了最先进的结果.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 计算机视觉 计算机视觉
背景情况:
- 尖端神经网络 (SNN) 是生物启发的模型,以低能耗和事件驱动处理而闻名.
- 目前的SNN面临的性能限制,尽管他们的潜力.
- 大脑的复杂架构激发了先进的信息处理能力.
研究的目的:
- 介绍一种新的尖端神经网络架构,即尖端全球局部融合变压器 (SGLFormer).
- 显著提高SNNs在计算机视觉任务中的性能.
- 解决现有的SNN架构的局限性,特别是关于梯度反向传播.
主要方法:
- 通过整合变压器和卷积结构,开发了尖端全球局部融合变压器 (SGLFormer).
- 引入了一种新的Maxpooling模块,以解决SNN中不准确的梯度反向传播问题.
- 在分类头中使用时空块 (STB) 来进行增强的特征聚合.
主要成果:
- 在静态数据集 (CIFAR10/100,ImageNet) 和动态视觉传感器 (DVS) 数据集 (CIFAR10-DVS,DVS128-手势) 上,SGLFormer表现出卓越的性能.
- 在 64 M 参数的 ImageNet 上实现了 83.73% 的 top-1 精度,超过了当前最先进的 SNNs 6.66%.
- 在直接训练的基准指标中表现优于现有的SNN.
结论:
- 在SGLFormer架构为计算机视觉SNN性能提供了显著的进步.
- 这种新的设计有效地处理全球和本地层面的信息.
- SGLFormer显示了支持未来更广泛的计算机视觉应用的希望.
相关概念视频
Energy Losses in Transformers
867
In an ideal transformer, it is assumed that there are no energy losses, and, hence, all the power at the primary winding is transferred to the secondary winding. However, in reality, the transformers always have some energy losses, and, hence, the output power obtained at the secondary winding is less than the input power at the primary winding due to energy losses.
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the...
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the...
867
Reducing Line Loss
152
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
152
Three-Winding Transformers
224
Three identical single-phase transformers can be configured to form a three-phase transformer connection, which involves high-voltage and low-voltage windings. The high-voltage windings are denoted by capital letters A-B-C, while the low-voltage windings are labeled with lowercase letters a-b-c, representing their respective phases. This notation helps distinguish between the high and low voltage sides of the transformer.
In the per-unit equivalent circuit of a grounded Y-Y three-phase...
In the per-unit equivalent circuit of a grounded Y-Y three-phase...
224
Equivalent Circuits for Practical Transformers
420
The practical equivalent circuits of single-phase two-winding transformers exhibit significant deviations from their idealized versions due to the inherent properties of winding resistance and finite core permeability. These properties result in real and reactive power losses, affecting the transformer's performance. Understanding these deviations is crucial for designing more efficient transformers.
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
420
The Ideal Transformer
387
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
387
Instrument Transformers
84
Instrument transformers, comprising voltage transformers (VTs) and current transformers (CTs), play crucial roles in power substations by providing isolated replicas of current or voltage for measurement and protection purposes. Voltage transformers reduce the primary voltage to levels suitable for relay operation and measurement, while current transformers scale down the primary current. The primary winding of a current transformer often consists of a single turn, achieved by threading the...
84


