实现可重复的序列学习模型:复制和分析一个模块化尖端网络,以奖励为基础的学习
Barna Zajzon1,2, Renato Duarte3, Abigail Morrison1,2
1Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-BRAIN Institute I, Jülich Research Centre, Jülich, Germany.
Frontiers in integrative neuroscience
|July 3, 2023
概括
这项研究增强了对大脑功能的序列学习模型. 研究人员重新实施了一个模型,测试了它的稳定性,并为神经硬件处理中的局限性提出了解决方案.
科学领域:
- 计算神经科学是一种神经科学.
- 认知科学 认知科学
- 神经科学是一个神经科学.
背景情况:
- 大脑处理空间时间结构化的信息来进行统计学习.
- 现有的序列学习计算模型往往缺乏功能性或生物物理可信性.
- 可访问,可复制和可比的模型对于理解神经序列处理至关重要.
研究的目的:
- 调查和增强最近提出的序列学习模型.
- 评估模型的稳定性,优势和弱点.
- 探索序列学习模型的生物可信约束.
主要方法:
- 在NEST模拟器中重新实现模块化柱状架构和基于奖励的学习规则.
- 复制原始研究的主要发现.
- 对参数设置和假设的模型稳定性的深入分析.
主要成果:
- 成功复制原始模型的发现.
- 限制的识别:序列顺序在连接方面是固定的.
- 证明核心功能在生物学上更合理的约束条件下被保留.
结论:
- 重新实施和分析为进一步研究神经序列学习提供了坚实的基础.
- 提出的解决方案解决了局限性,提高了模型的适用性.
- 该研究强调了模型可访问性和生物可信性在神经科学中的重要性.
相关概念视频
Observational Learning
213
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
213
Sequence Networks of Rotating Machines
125
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
125
Reinforcement Schedules
208
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
208
Per-Unit Sequence Models
98
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
98
Associative Learning
452
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
452
Reinforcement
282
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
282


