构建和打破链条:奖励预测错误整合和记忆细分的模型
Nina Rouhani1, David Clewett2, James W Antony3
1California Institute of Technology.
Journal of cognitive neuroscience
|July 11, 2024
概括
预测错误通过整合类似事件或分割不同的事件来塑造记忆. 签名错误促进了整合,而未签名错误推动了细分,影响了时间顺序的记忆.
科学领域:
- 神经科学是一个神经科学.
- 认知科学 认知科学
- 计算建模 计算建模
背景情况:
- 预测错误对于强化学习和情节性记忆组织至关重要.
- 中脑的多巴胺,位和海马体在事件认知中发挥着关键作用.
- 记忆集成和细分中的预测错误之间的相互作用仍然不清楚.
研究的目的:
- 提出并模拟两个预测错误信号对事件集成和内存细分的理论影响.
- 调查签名和未签名奖励预测错误如何对心理模型和上下文相似性产生不同影响.
- 解释上下文相似性对时间顺序记忆模式的影响.
主要方法:
- 在事件认知中对神经调节系统 (多巴胺,心脏,海马) 的审查.
- 开发一个模拟预测错误信号的计算模型.
- 在关联链接和顺序检索任务中分析模型性能.
主要成果:
- 签名奖励预测错误通过构建稳定的奖励环境模型来促进上下文相似性 (整合).
- 无标记的奖励预测错误标志着新的环境模型,导致上下文转移 (细分).
- 模拟显示了整合和细分对关联链和时间顺序记忆的差异效应.
结论:
- 一个统一的解释,神经调节系统如何通过预测错误影响事件认知和记忆.
- 记忆组织中签名 (整合) 和未签名 (细分) 预测错误的不同作用.
- 计算模型成功解释了复杂的时间顺序记忆现象.
相关概念视频
01:16Interference and Decay
127
Forgetting is a complex cognitive phenomenon influenced by several factors, among which interference and decay are particularly prominent. These processes explain why individuals often struggle to retrieve specific information from memory, leading to lapses in recall that can be observed in everyday situations.
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
Interference occurs when competing memories hinder the retrieval of particular information. It can be classified into two types: proactive and retroactive interference. Proactive...
127
01:22Chunking and Rehearsal in Sensory Memory
198
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
198
01:03Prediction Intervals
2.2K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
2.2K
01:12Retrieval
106
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
106
01:24Working Memory
151
Working memory refers to a combination of components, including short-term memory and attention, that allow an individual to hold information temporarily as we perform cognitive tasks. It is an essential cognitive function that enables the execution of complex tasks such as problem-solving, comprehension, and reasoning. Unlike short-term memory, which simply involves the storage of information for a brief period, working memory involves the active manipulation and processing of this...
151
01:19Role of Hippocampus in Memory
212
The hippocampus, a critical brain structure, plays an essential role in memory processing, particularly in the formation and retrieval of memory. This small, seahorse-shaped region is located within the medial temporal lobe, with one hippocampus in each brain hemisphere. Experimental studies involving lesions in the hippocampi of rats have demonstrated significant impairments in tasks such as object recognition and maze navigation, indicating the hippocampus involvement in both recognition and...
212