有限制的视觉表示学习与双模拟指标,以确保安全的强化学习
相关实验视频
Updated: Jul 13, 2026

06:12
Long-term Sensory Conflict in Freely Behaving Mice
Published on: February 20, 2019
6.6K
概括
使用双模拟指标 (CVRL-BM) 进行受约束的视觉表示学习,通过从视觉数据中创建紧的状态表示来增强安全的强化学习. 这种方法提高了复杂环境中的决策安全性和效率.
科学领域:
- 人工智能的人工智能
- 机器人技术 机器人技术 机器人技术
- 机器学习 机器学习
背景情况:
- 安全的强化学习 (RL) 对现实应用至关重要,特别是那些使用视觉输入的应用.
- 从高维度视觉数据中提取安全决策的基本特征,同时保持样本效率仍然是一个挑战.
研究的目的:
- 提出一种新的方法,限制视觉表示学习与双模拟指标 (CVRL-BM),用于从视觉观察中有效和安全的强化学习.
- 开发一个模型,学习紧的,信息性的状态表示,同时遵守安全约束.
主要方法:
- CVRL-BM使用了一种序列条件变异推理模型,将视觉观测压缩成低维状态表示.
- 安全双模拟指标被纳入以量化状态行为相似性,指导学习隐藏状态表示.
主要成果:
- 在安全健身房的实验表明,与现有的基于视觉的安全RL方法相比,CVRL-BM在安全性和有效性方面的表现优越.
- 与最先进的安全SLAC方法相比,CVRL-BM实现了19.7%更高的回报率和41.7%更低的成本回报率.
- 观察到成本遗憾减少了5.0%,突出显示了该方法在降低风险方面的有效性.
结论:
- CVRL-BM有效地学习了紧而有信息的视觉状态表示,用于安全的强化学习.
- 代表性学习和安全模拟指标的整合使安全关键应用程序的性能稳定.
更多相关视频
08:59An Open-Source Virtual Reality System for the Measurement of Spatial Learning in Head-Restrained Mice
Published on: March 3, 2023
1.9K
07:12Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
263
相关概念视频
Reinforcement
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Avoidance Learning and Learned Helplessness
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Observational Learning
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...