清醒-睡眠 巩固学习
IEEE transactions on neural networks and learning systems
|September 26, 2024
概括
唤醒-睡眠合并学习 (WSCL) 通过模仿人类大脑来增强深层神经网络,以进行持续的视觉分类.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 深度神经网络 (DNN) 由于灾难性遗忘而扎于持续学习 (CL).
- 现有的CL方法往往缺乏生物可信性或有效的记忆巩固机制.
研究的目的:
- 引入Wake-Sleep Consolidated Learning (WSCL),这是一个用于改善DNN在CL环境中的性能的新策略.
- 为了利用人类大脑的觉醒睡眠周期和辅助学习系统 (CLS) 理论,实现更有效的持续学习.
主要方法:
- WSCL同步不同的觉醒和睡眠阶段,以实现持续的学习.
- 觉醒阶段适应表现和存储情节性记忆.
- 睡眠阶段通过非快速眼动 (NREM) 巩固突触重量,并通过快速眼动 (REM) "梦想"探索特征空间.
主要成果:
- WSCL显著优于基线方法和CIFAR-10,CIFAR-100,Tiny-ImageNet和FG-ImageNet数据集的先前工作.
- 这项研究证明了WSCL所有处理阶段的有效性,包括"梦想"REM阶段.
- 积极的期货转移 (FWT) 是通过拟议的"梦想"机制显著实现的.
结论:
- WSCL为持续视觉分类提供了一种生物灵感和有效的方法.
- 清醒睡眠周期,特别是REM"梦"阶段,对于强大的持续学习和知识传递至关重要.
- 拟议的方法为开发更具适应性和效率的AI系统提供了一个有希望的方向.
更多相关视频
08:08Eye Tracking, Cortisol, and a Sleep vs. Wake Consolidation Delay: Combining Methods to Uncover an Interactive Effect of Sleep and Cortisol on Memory
Published on: June 18, 2014
27.1K
08:58Optogenetic Manipulation of Neural Circuits During Monitoring Sleep/wakefulness States in Mice
Published on: June 19, 2019
9.7K
相关概念视频
Sleep-Wake Cycles
1.2K
Sleep is an essential physiological process vital to maintaining overall well-being. The reticular activating system (RAS), a network of neurons in the brainstem, regulates wakefulness and sleep. While it may seem passive, sleep consists of distinct cycles, each with its unique characteristics and functions. Two key sleep phases are non-rapid eye movement (NREM) and rapid eye movement (REM).
NREM Sleep
NREM sleep comprises four progressive stages that seamlessly merge:
NREM Sleep
NREM sleep comprises four progressive stages that seamlessly merge:
1.2K
Understanding Sleep
221
Sleep, an essential biological state, involves significant reductions in physical activity, sensory awareness, and interaction with the environment. This complex physiological process is primarily regulated by specific brain regions, notably the hypothalamus and pons, which govern the sleep-wake cycle or circadian rhythm.
The circadian rhythm, a nearly 24-hour cycle, is deeply influenced by environmental light cues. Light exposure directly affects the hypothalamus, which in turn regulates...
The circadian rhythm, a nearly 24-hour cycle, is deeply influenced by environmental light cues. Light exposure directly affects the hypothalamus, which in turn regulates...
221
Stages of Sleep
176
Sleep progresses through distinct stages, each characterized by specific brain wave patterns and physiological responses ranging from wakefulness to stages of non-rapid eye movement, known as non-REM, to rapid eye movement, referred to as REM. Understanding these stages helps in recognizing how sleep supports various bodily and cognitive functions.
Before sleep begins, in wakefulness, the brain exhibits primarily beta waves, which are high in frequency and low in amplitude, indicating alertness...
Before sleep begins, in wakefulness, the brain exhibits primarily beta waves, which are high in frequency and low in amplitude, indicating alertness...
176
REM Sleep Behavior Disorder
161
REM Sleep Behavior Disorder (RBD) is a sleep disorder characterized by the absence of muscle paralysis that normally occurs during the REM phase of sleep. This absence allows individuals to physically act out their dreams, which are often vivid and disturbing. Common behaviors exhibited during episodes include kicking, punching, and yelling. These actions can be dangerous, potentially leading to injuries for the person with RBD or their bed partner.
RBD is significantly associated with...
RBD is significantly associated with...
161
Sleepwalking and Sleep Talking
124
Somnambulism, commonly known as sleepwalking, involves individuals engaging in activities ranging from simple walking to more complex behaviors such as driving. Sleepwalking typically occurs during the slow-wave sleep stages 3 and 4 early in the night when the person is not dreaming, contradicting the myth that sleepwalkers are acting out their dreams.
Factors that increase the likelihood of sleepwalking include sleep deprivation and alcohol consumption. Contrary to common beliefs, it is safe...
Factors that increase the likelihood of sleepwalking include sleep deprivation and alcohol consumption. Contrary to common beliefs, it is safe...
124
Cognitive Learning
229
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
229
