尖的塔克融合变压器用于视听零射击学习
概括
这项研究介绍了用于视听零射击学习的尖端塔克融合变压器 (STFT),有效地结合了尖端神经网络和变压器. 新型STFT模型在基准数据集上取得了最先进的结果.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 尖端神经网络 (SNN) 在时间序列编码方面出色,用于视听特征提取.
- 将SNN (二进制) 与变压器 (浮点) 集成为时间语义分析带来了挑战.
研究的目的:
- 为视听零射击学习 (ZSL) 引入一种新的尖端塔克融合变压器 (STFT).
- 加强在视听数据中的时间和语义信息的联合探索.
主要方法:
- 开发了一种集成SNN和变压器的尖端塔克融合变压器 (STFT).
- 引入了一个时间步骤因子 (TSF),用于推断信息的动态合成.
- 拟议的全球-本地聚合 (GLP) 引导膜潜力并减少尖端噪声.
- 实现了一个时间-语义的塔克尔融合模块,用于多尺度的融合和第二阶交互维护.
主要成果:
- 在三个基准数据集 (VGGSound,UCF101,ActivityNet) 上实现了最先进的性能.
- 显示了显著的平均值 (HM) 改进:15.4%在VGGSound上,3.9%在UCF101上,14.9%在ActivityNet上.
结论:
- 该STFT有效地融合了来自SNN和变压器的时间和语义信息.
- 拟议的方法解决了将二进制SNN与ZSL的浮点变压器集成的挑战.
- 该方法为视听零射击学习任务提供了强大的解决方案.
相关概念视频
Transformers in Distribution System
99
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
99
Types Of Transformers
961
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
961
Transformers with Off-Nominal Turns Ratios
149
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
149
The Ideal Transformer
370
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
370
Energy Losses in Transformers
857
In an ideal transformer, it is assumed that there are no energy losses, and, hence, all the power at the primary winding is transferred to the secondary winding. However, in reality, the transformers always have some energy losses, and, hence, the output power obtained at the secondary winding is less than the input power at the primary winding due to energy losses.
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the...
There are four main reasons for energy losses in transformers.
The first cause can be the high resistance of the...
857
Reconstruction of Signal using Interpolation
187
Signal processing techniques are essential for accurately converting continuous signals to digital formats and vice versa. When a continuous signal is sampled with a period T, the resulting sampled signal exhibits replicas of the original spectrum in the frequency domain, spaced at intervals equal to the sampling frequency. To handle this sampled signal, a zero-order hold method can be applied, which creates a piecewise constant signal by retaining each sample's value until the next...
187


