增强对关联记忆的表示学习
Naresh Ravichandran1, Anders Lansner1,2, Pawel Herman1,3,4
1Computational Cognitive Brain Science Group, Department of Computational Science and Technology, School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology, Stockholm, Sweden.
Frontiers in neuroscience
|October 7, 2024
概括
这项研究介绍了一种用于无监督学习和关联记忆的新型尖端神经网络 (SNN). 该模型以新皮层组织为灵感,展示了像模式完成和原型提取这样的功能.
科学领域:
- 计算神经科学是一种神经科学.
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 尖端神经网络 (SNN) 是生物启发的计算模型.
- 与深度学习相比,当前的SNN在扩展和现实数据处理方面面临着挑战.
- 有效地学习分布式表示对于SNN的感知和认知功能至关重要.
研究的目的:
- 介绍一种新的SNN架构,用于无监督表示学习和关联记忆.
- 解决当前SNN模型的缩放和现实应用的局限性.
- 利用生物学上可信的可塑性机制来提高SNN的性能.
主要方法:
- 开发了一种新的SNN,利用Hebbian突触和活动依赖的结构可塑性.
- 模拟神经元单元作为Poisson尖峰发生器,具有稀疏的发射率.
- 设计了一种新皮层柱体灵感的建筑,具有前和反复投影.
主要成果:
- 该SNN成功地进行了无监督的表示学习.
- 该模型展示了关联性记忆功能,包括模式完成和原型提取.
- 评估了基于吸引力的记忆特性 (如抗扭曲和感知竞争) 的性能.
结论:
- 拟议的SNN模型为无监督学习和关联记忆提供了一个有希望的方法.
- 架构和可塑性规则为先进的神经计算提供了一个生物学上可信的框架.
- 这项工作推进了SNN在复杂的现实应用中的潜力.
相关概念视频
Associative Learning
308
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
308
Long-term Potentiation
2.7K
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when...
Hebbian LTP
LTP can occur when...
2.7K
Higher Mental Functions of Brain: Learning and Memory
692
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
692
Chunking and Rehearsal in Sensory Memory
174
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
174
Storage
74
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
74
Real-World Application of Classical Conditioning
531
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
531


