具有多个路径的深线性网络的学习动态
Jianghong Shi1, Eric Shea-Brown1, Michael A Buice2
1Department of Applied Mathematics, University of Washington, Seattle, WA 98195.
Advances in neural information processing systems
|January 30, 2024
概括
具有平行路径的深度神经网络,与串行网络不同,学习专业化. 不同的特征集中在不同的路径中,提高人工和生物系统的计算效率.
科学领域:
- 计算神经科学是一种计算神经科学.
- 机器学习理论机器学习理论
背景情况:
- 深度神经网络是机器学习的标准,并被用作皮质计算模型.
- 哺乳动物的大脑表现出平行通路,与深度网络的典型串行组织形成鲜明对比.
研究的目的:
- 在具有并行计算路径的网络中数学分析学习动态.
- 调查具有相同成本功能的并行架构如何处理信息.
主要方法:
- 深度线性网络与大型隐藏层的近似.
- 分析导出和数值模拟 (线性和非线性网络).
主要成果:
- 平行路径的深度增加导致特征集中在特定的路径中.
- 平行路径开发专业的表示,而不是共享功能.
结论:
- 平行网络架构促进多样化表示和路径专业化.
- 这种专业化机制可能对生物和人工系统中的信息处理至关重要.
更多相关视频
05:41A Step-by-Step Implementation of DeepBehavior, Deep Learning Toolbox for Automated Behavior Analysis
Published on: February 6, 2020
9.4K
10:44Inherent Dynamics Visualizer, an Interactive Application for Evaluating and Visualizing Outputs from a Gene Regulatory Network Inference Pipeline
Published on: December 7, 2021
2.2K
相关概念视频
Neural Circuits
1.2K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.2K
Long-term Potentiation
55.2K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
55.2K
Direct Motor Pathways
2.0K
The direct motor pathways, also known as the pyramidal tracts, are a group of neural pathways that originate in the brain and descend through the spinal cord. They control the voluntary movement of the body. There are two major direct motor pathways: the corticospinal and the corticobulbar tracts.
The corticospinal tract is responsible for the voluntary movement of the limbs and trunk. It originates in the cerebral cortex of the brain and descends through the cerebrum's internal capsule and...
The corticospinal tract is responsible for the voluntary movement of the limbs and trunk. It originates in the cerebral cortex of the brain and descends through the cerebrum's internal capsule and...
2.0K
Neuroplasticity
361
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
361
Diversity in Cell Signaling Responses
6.4K
The physiological function of a cell and cellular communication are outcomes of a range of extrinsic signals, intracellular signaling pathways, and cellular responses. No two cell types express the same repertoire of signaling components. Receptors are highly selective for their cognate ligands, but once activated, they can alter multiple cellular processes such as DNA transcription, protein synthesis, and metabolic activity.
Graded and Abrupt Responses
Some signaling systems generate...
Graded and Abrupt Responses
Some signaling systems generate...
6.4K
Interactions Between Signaling Pathways
6.3K
Signaling cascades usually lack linearity. Multiple pathways interact and regulate one another, allowing cells to integrate and respond to diverse environmental stimuli.
Convergence and divergence, and cross-talk between signaling pathways
Two distinct signaling pathways can converge on a single functional unit, which may either be a single protein or a complex of proteins. The response is either functionally distinct or synergistic between the two pathways but different from the response...
Convergence and divergence, and cross-talk between signaling pathways
Two distinct signaling pathways can converge on a single functional unit, which may either be a single protein or a complex of proteins. The response is either functionally distinct or synergistic between the two pathways but different from the response...
6.3K
