从强化学习的角度来看,记忆的巩固
Jong Won Lee1, Min Whan Jung1,2
1Center for Synaptic Brain Dysfunctions, Institute for Basic Science, Daejeon, Republic of Korea.
Frontiers in computational neuroscience
|January 23, 2025
概括
记忆巩固将暂时的记忆转化为持久的记忆. 这个过程可以作为线下强化学习,使用模拟来增强适应性决策和策略推导.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算神经科学是一种神经科学.
背景情况:
- 记忆巩固将短期记忆转化为长期记忆.
- 海马,特别是CA3和CA1区域,对于记忆,想象力,未来规划和估值至关重要.
- CA3产生新的活动模式,而CA1评估和加强它们以实现奖励最大化.
研究的目的:
- 为记忆巩固提出一个新的框架.
- 将海马功能与强化学习原理联系起来.
- 将内存整合重新定义为基于模拟的优化过程.
主要方法:
- 文献综述和对海马功能和记忆巩固现有发现的综合.
- 概念建模将海马子区域 (CA3,CA1) 与强化学习 (Dyna算法) 联系起来.
- 基于神经生物学证据和计算算法的理论框架开发.
主要成果:
- 在CA3区域产生多样化的神经活动模式.
- CA1区域评估和加强模式,最大限度地提高奖励.
- 记忆巩固可以被概念化为线下强化学习.
结论:
- 记忆巩固可能是一个离线强化学习过程.
- 这一框架增强了对适应性决策的理解.
- 记忆中的海马体功能类似于人工智能中的基于模拟的学习.
相关概念视频
Chunking and Rehearsal in Sensory Memory
144
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
144
Higher Mental Functions of Brain: Learning and Memory
651
Memory is one of the most vital higher mental functions of the brain. Memory is closely related to learning because it enables us to retain information and experiences from our past to use them in our present life. It also helps us to remember facts, events, and skills, such as riding a bike or swimming. There are two types of memory — declarative memory, which involves memorizing facts or events, and procedural memory, which enables us to remember how to do something like writing or...
651
Interference and Decay
107
Forgetting is a complex cognitive phenomenon influenced by several factors, among which interference and decay are particularly prominent. These processes explain why individuals often struggle to retrieve specific information from memory, leading to lapses in recall that can be observed in everyday situations.
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
107
Elaborative Rehearsals
77
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
77
Implicit Memories
93
Implicit memories, also known as non-declarative memories, are long-term memories that function outside of conscious awareness. These memories influence behavior and skills without explicit knowledge. This type of memory is evident in tasks like playing tennis, snowboarding, and texting. Implicit memory has three subsystems: procedural memory, conditioning, and priming. This type of memory is essential in various activities, from everyday tasks to specialized skills.
One key aspect of implicit...
One key aspect of implicit...
93
Understanding Memory
250
Memory is the retention of information or experiences over time, facilitated through three main processes: encoding, storage, and retrieval. Encoding is the process of inputting information into the memory system. For instance, when listening to a lecture, watching a play, reading a book, or having a conversation, the brain is actively encoding information. This initial stage involves transforming sensory input into a form that can be processed and stored by the brain. Various factors, such as...
250


