恐惧神经启发的强化学习为安全的自动驾驶
IEEE transactions on pattern analysis and machine intelligence
|October 6, 2023
概括
这项研究引入了一种由大脑桃体启发的新增强化学习框架,以提高自动驾驶的安全性. 这种以恐惧神经启发的方法在关键的驾驶场景中显著减少了安全违规行为.
科学领域:
- 神经科学和人工智能 人工智能
- 自主驾驶系统 自主驾驶系统
- 机器学习安全 机器学习安全
背景情况:
- 自动驾驶汽车在安全和人类水平的性能方面面临挑战,特别是在危急情况下.
- 强化学习 (RL) 对复杂任务具有前景,但对现实世界的自动驾驶缺乏安全保证.
- 大脑的桃体在威胁检测和防御反应中发挥着至关重要的作用,这对于在危险环境中导航至关重要.
研究的目的:
- 通过模拟杏仁体功能来开发自动驾驶的安全强化学习框架.
- 为了使自主代理人能够学习防御行为,并在安全关键场景中改善决策.
- 解决当前RL技术在确保自动驾驶汽车安全方面的局限性.
主要方法:
- 开发了一个新的恐惧神经启发强化学习框架.
- 该框架模拟了杏仁体的功能方面,以引起防御反应.
- 在使用拟议的框架,对自动驾驶代理进行了实验测试.
主要成果:
- 拟议的框架有助于代理人学习防御行为,从而减少安全违规行为.
- 与基线代理相比,自动驾驶代理实现了最先进的性能.
- 该系统的性能与安全关键场景中经过认证的人类驾驶员的性能相当.
结论:
- 恐惧神经启发的强化学习框架有效提高了自动驾驶的安全性.
- 模拟杏仁体功能对于在自动驾驶汽车等安全关键应用中推进RL至关重要.
- 这种方法证明了一条通往更安全,更可靠的自动驾驶系统的可行途径.
相关概念视频
01:14Avoidance Learning and Learned Helplessness
1.7K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.7K
01:12Observational Learning
193
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
193
01:23Reinforcement
244
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
244
01:22Autonomic Nervous System
9.0K
The autonomic nervous system (ANS) is a critical component of the peripheral nervous system, primarily responsible for regulating involuntary bodily functions and maintaining homeostasis. It functions in tandem with the central nervous system (CNS) to seamlessly coordinate various physiological processes without the need for conscious control.
The ANS comprises two main divisions: the sympathetic and parasympathetic divisions. These divisions function antagonistically to maintain a dynamic...
The ANS comprises two main divisions: the sympathetic and parasympathetic divisions. These divisions function antagonistically to maintain a dynamic...
9.0K
01:17Rolling Resistance: Problem Solving
353
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
353
01:18Neural Control of Respiration
2.5K
The neural regulation of respiration is a meticulously coordinated process primarily controlled by the respiratory centers located within the brainstem. These centers, composed of specialized neurons, transmit nerve impulses that control the contraction and relaxation of our respiratory muscles.
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
Respiratory Centers in the Brainstem
Two primary areas comprise the respiratory center: the medullary respiratory center in the medulla oblongata and the pontine respiratory group in the pons. The...
2.5K