乘法合促进了在循环神经网络中的快速学习和信息接
bioRxiv : the preprint server for biology
|July 17, 2025
概括
这项研究引入了一种新的递归神经网络 (RNN) 和前神经网络 (FNN) 之间的多重合机制,灵感来自哺乳动物大脑结构. 这种神经科学启发的计算显著提高了人工智能模型的学习速度和能力.
科学领域:
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 哺乳动物前脑负责更高的认知,其结构与现代机器学习系统有相似之处,皮质类似于循环神经网络 (RNN),丘脑类似于前进神经网络 (FNN).
- 这些架构特征对前脑学习能力的贡献的确切机制在很大程度上是未知的.
研究的目的:
- 在学习和计算过程中研究甲状腺皮层相互作用的功能作用.
- 开发一种新的计算机制,灵感来自于甲状腺皮层架构,以增强人工神经网络中的学习.
主要方法:
- 在RNN和FNN架构之间开发一个乘法合机制.
- 实施Hebbian重量放大和突触神经合用于上下文依赖的门和快速切换.
- 在监督,强化和无监督学习范式中展示多重反驱动的突触可塑性.
主要成果:
- 在各种学习环境中实现了2-100倍的速度改进,提高了RNN中的记忆能力,模型稳定性和概括性.
- 在模拟复杂的大脑电路 (包括决策,工作记忆和导航) 中验证了乘法门的生物可信性和有效性.
- 通过神经科学启发的方法,证明了多塑料吸引力动力学和在循环神经回路中增强的计算.
结论:
- 拟议的乘法合机制为人工智能提供了显著的计算优势,与生物神经处理有相似之处.
- 这项研究为神经科学启发的计算提供了深刻的见解,突出了模仿大脑结构以实现先进的人工智能能力的潜力.
更多相关视频
07:51Inhibitory Synapse Formation in a Co-culture Model Incorporating GABAergic Medium Spiny Neurons and HEK293 Cells Stably Expressing GABAA Receptors
Published on: November 14, 2014
17.5K
09:09Electrophysiological Investigations of Retinogeniculate and Corticogeniculate Synapse Function
Published on: August 7, 2019
6.2K
相关概念视频
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Multi-input and Multi-variable systems
150
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
150
The Role of Ion Channels in Neuronal Computation
3.3K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.3K
Associative Learning
593
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
593
Neural Regulation
40.2K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
40.2K
Propagation of Action Potentials
6.9K
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
6.9K
