相关实验视频
Updated: Feb 6, 2026

Fabrication and Design of Wood-Based High-Performance Composites
Published on: November 9, 2019
电路解释:变压器如何执行组合概括?
Cheng Tang1, Brenden Lake2, Mehrdad Jazayeri1,3
1Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
研究人员确定并解释了神经网络电路,使变压器中的组成概括成为可能. 这个电路使用位置和身份表示来构建函数,为AI中的符号推理提供了洞察力.
科学领域:
- 人工智能的人工智能
- 认知科学 认知科学
- 机器学习 机器学习
背景情况:
- 构成性概括是人类认知的关键,但在神经网络中不太了解.
- 之前的工作证明了变压器可以在序列任务上实现简单的组成概括.
研究的目的:
- 在变压器模型中机械地解释负责构成概括的电路.
- 了解神经网络是如何实现符号组成的.
主要方法:
- 利用因果除来隔离特定的神经回路.
- 执行精确的激活编辑来分析电路行为.
- 调查了代币位置和身份的脱而出的表征.
主要成果:
- 确定了一个执行函数组合的电路.
- 该电路使用基于位置和身份的一般令牌重新映射规则,而不是特定的函数语义.
- 激活编辑可预测的引导模型输出.
结论:
- 已识别的电路为变压器中的组成概括提供了机械解释.
- 这一发现为大规模AI模型中类似机制提供了可测试的假设.
- 了解这些电路可以促进人工智能和认知科学研究.
更多相关视频
10:30A Generalized Method for Determining Free Soluble Phenolic Acid Composition and Antioxidant Capacity of Cereals and Legumes
Published on: June 10, 2022
04:09Author Spotlight: Streamlining Composite Plant Production via Agrobacterium rhizogenes-Mediated Hairy Root Transformation
Published on: June 30, 2023
相关概念视频
Equivalent Circuits for Practical Transformers
In a practical transformer, each winding exhibits resistance and leakage reactance. The...
Source Transformation for AC Circuits
Generalized Hooke's Law
Generalized Anxiety Disorder
Social Foundations of Self II: The Generalized Other
Generalization, Discrimination, and Extinction
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...