多个自我监督的辅助任务用于目标驱动的视觉导航使用深度强化学习学习
Wenzhi Zhang1, Li He1, Hongwei Wang1
1School of Mechanical Engineering, Xinjiang University, Urumqi 830046, China.
Entropy (Basel, Switzerland)
|July 29, 2023
概括
本研究引入了使用自主监督学习进行视觉导航的新框架,显著提高了培训效率和性能. 该方法直接从图像中学习,减少对大量数据和计算资源的需求.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 视觉导航的深度强化学习需要大量的环境互动和训练时间,因为奖励稀少.
- 当前的方法通常依赖于预先设计的特性或演示,限制了适应性和样本效率.
研究的目的:
- 在深度强化学习中提高样本效率和导航性能,用于视觉导航.
- 开发一个框架,可以直接从高维图像中学习导航策略,而无需手动功能工程或先前演示.
主要方法:
- 提出了一个新的框架,利用多个自我监督的辅助任务来进行视觉导航.
- 实施基于LSTM的动态模型和基于注意力的图像重建模型作为辅助任务.
- 专注于直接从原始,高维图像中学习潜伏表示,绕过传统ResNet特征的需求.
主要成果:
- 提出的自主监督辅助任务显著提高了培训效率.
- 与基线算法相比,该框架展示了优越的导航性能.
- 在模拟和现实世界的图像数据集上验证了有效性.
结论:
- 开发的框架提高了深度强化学习的样本效率和导航性能.
- 从原始图像进行自主监督学习为特征工程和演示提供了可行的替代方案.
- 这种方法减少了对视觉导航任务的大量培训时间和计算资源的依赖.
相关概念视频
Observational Learning
210
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
210
Associative Learning
444
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
444
Depth Perception and Spatial Vision
726
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
726
Purposive Learning
142
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
142
Reinforcement
277
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
277
Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K


