神经进化导致了与反复传播相比,在循环神经网络中更专注的信息传输
Arend Hintze1, Christoph Adami2
1Department for MicroData Analytics, Dalarna University, Falun, Sweden.
Neural computing & applications
|January 27, 2025
概括
神经进化训练人工神经网络 (ANN) 不同于反向传播. 这导致ANN中的信息传输更加专注和强大,影响人工通用智能发展.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
背景情况:
- 人工神经网络 (ANN) 是受生物大脑的启发,但在连接和训练方面有所不同.
- 现代ANN使用反向传播,而生物大脑则在数以千计的时间内进化.
研究的目的:
- 研究训练方法如何影响人工神经网络中的信息传播.
- 为了比较通过神经进化训练的ANN中的信息传输与反向传播.
主要方法:
- 测量转移来量化神经元组之间的信息流.
- 分析连接重量分布和对干扰的强度.
主要成果:
- 训练方法对连接重量分布的影响最小.
- 与反向传播相比,神经进化导致较小的神经元组之间的信息传输更加集中.
- 经过神经进化训练的网络对重量干扰具有更大的稳定性.
结论:
- 培训方法在很大程度上影响了ANN中的信息处理和中继.
- 当地与全球训练属性影响神经信息动态,即使具有相似的性能.
相关概念视频
Neuroplasticity
277
Neuroplasticity reflects the brain's remarkable capacity to adapt and evolve, responding dynamically to learning, experiences, or injury by reorganizing its neural circuitry. This reorganization involves creating new neural connections and refining old ones through a series of biological processes that contribute to the brain's lifelong development and adaptability.
277
Neural Circuits
1.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.0K
Neuronal Communication
767
Neurons, the fundamental units of the brain and nervous system, communicate through complex electrochemical signals that underpin all cognitive and bodily functions. This communication is primarily facilitated by a process involving the generation and propagation of an action potential along the axon of the neuron. When the internal electrical charge of a neuron surpasses a certain threshold, an action potential is triggered. This rapid change in voltage travels swiftly along the axon to the...
767
Neurogenesis and Regeneration of Nervous Tissue
701
In the CNS, neurogenesis, the birth of new neurons from stem cells, is limited to the hippocampus in adults. In other regions of the brain and spinal cord, neurogenesis is almost non-existent due to inhibitory influences from neuroglia, especially oligodendrocytes, and the absence of growth-stimulating cues. The myelin produced by oligodendrocytes in the CNS inhibits neuronal regeneration. Furthermore, astrocytes proliferate rapidly after neuronal damage, forming scar tissue that physically...
701
The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K
Long-term Potentiation
2.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.7K


