一个统一的和生物学上可信的视觉转换器的关系图表表示
IEEE transactions on neural networks and learning systems
|January 1, 2024
概括
视觉转换器 (ViT) 现在具有统一的图形表示. 这种新的方法揭示了人造神经网络和生物神经网络之间的相似之处,提高了ViT的性能.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 计算机视觉 计算机视觉
背景情况:
- 视觉转换器 (ViT) 由于其空间补丁信息聚合,在各种任务中表现出色.
- 系统性绩效评估缺乏ViT架构的统一表示.
- ViT与生物神经网络 (BNN) 的生物学可信性和相似性仍然未得到充分探索.
研究的目的:
- 为视觉转换器 (ViT) 提出一个统一的,生物学上可信的关系图表表示.
- 系统地理解和评估不同ViT架构的表示性能.
- 探索ViT人工神经网络 (ANN) 和生物神经网络 (BNN) 之间的相似之处.
主要方法:
- 开发了ViT模型的统一关系图表示,包括聚合和亲属子图.
- 聚合图模拟了ViT令牌 (节点) 之间的空间相互作用.
- 亲缘图模型是网络通道 (节点) 之间的信息通信.
主要成果:
- 模型性能与来自统一表示的图表测量有很强的相关性.
- 拟议的ViT的关系图表表示与真实BNN具有显著的相似性.
- 使用高级模型限制聚合图导致ViT性能得到改善.
结论:
- 统一的关系图表表示为分析ViT架构提供了一个新的框架.
- ViT ANNs与BNNs具有结构和功能上的相似之处,这表明生物灵感人工智能的潜力.
- 这种表示方便人们更深入地了解ViT机制和性能优化.
相关概念视频
Types Of Transformers
978
Transformers can provide desired voltages to a circuit by modifying the number of turns in the secondary windings.
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
978
Transformers in Distribution System
103
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
103
Vision
53.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.4K
Visual System
585
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
585
Transformers with Off-Nominal Turns Ratios
157
In scenarios involving parallel transformers with disparate ratings, developing per-unit models requires accommodating off-nominal turns ratios. This situation arises when the selected base voltages are not proportional to the transformer’s voltage ratings. Consider a transformer where the rated voltages are related by the term a. If the chosen voltage bases satisfy a relationship involving term b, term c is defined as the ratio of these bases. This ratio is then substituted into the...
157
The Ideal Transformer
397
In single-phase two-winding transformers, two windings are coiled around a magnetic core characterized by cross-sectional area A and magnetic permeability μ. A phasor current i1 enters the left winding while i2 exits the right winding, establishing the fundamental working of the transformer through electromagnetic principles.
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
397


