类似于Hopfield的网络,具有对记忆的互补编码
Louis Kang1,2, Taro Toyoizumi3,4
1Neural Circuits and Computations Unit, RIKEN Center for Brain Science, 2-1 Hirosawa, Wako-shi, Saitama 351-0198, Japan.
Physical review. E
|December 20, 2023
概括
这项研究介绍了一种能够在示例和概念层面上存储和检索记忆的新型自关联网络. 该网络从示例中学习概念,并执行异构关联,提供统一的记忆系统.
科学领域:
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
- 认知科学 认知科学
背景情况:
- 传统的自联网络很难区分具体的例子和抽象的概念.
- 用关联和脱关联模式表示记忆对于灵活的信息检索至关重要.
研究的目的:
- 开发一个统一的自关联网络模型,能够在示例和概念尺度上检索记忆.
- 调查网络从示例中学习概念的能力,并执行异构关联.
主要方法:
- 设计了一个类似霍普菲尔德的自动关联网络架构.
- 记忆被编码使用两个互补的活动模式:密集 (相关) 和稀疏 (不相关).
- 为了分析网络容量和性能,我们得出了宏观的平均场方程.
主要成果:
- 通过调整活动值,网络成功地检索了稀疏模式 (示例) 和密集模式 (概念).
- 学习的概念来自于在密集表示中积累的共同特征.
- 稀疏的表示保持了示例区别,使得高内存容量.
结论:
- 一个单一的网络可以有效地存储和检索在多个抽象级别 (例子和概念) 的信息.
- 拟议的模型展示了异性关联能力,将不同的记忆联系起来.
- 理论推导和模拟证实了网络的容量和功能多功能性.
相关概念视频
Storage
86
A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
86
Encoding
174
Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...
174
Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K
Forgetting
79
Forgetting is an intrinsic aspect of human memory, characterized by the gradual loss or inaccessibility of information over time. Hermann Ebbinghaus, a pioneering psychologist, extensively studied this phenomenon and formulated the forgetting curve. This curve illustrates that memory loss occurs rapidly immediately after learning and then decelerates over time. Several mechanisms contribute to forgetting, including encoding failure, storage decay, retrieval failure, and interference.
Encoding...
Encoding...
79
Role of Neurotransmitters in Memory
571
Neurotransmitters are integral to the brain's communication system, enabling neurons to transmit signals across synapses. This chemical exchange underpins various cognitive functions, including memory processes. The role of neurotransmitters in memory is multifaceted, influencing the encoding, consolidation, and retrieval of memories through their action on different neural circuits.
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is...
Glutamate and Synaptic Plasticity
Glutamate, the brain's main excitatory neurotransmitter, is...
571
Associative Learning
399
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
399


