对于层次强化运动学习的成功有效/安全策略
Jan Babič1, Tjasa Kunavar1,2, Erhan Oztop3,4
1Laboratory for Neuromechanics and Biorobotics, Department of Automatics, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia.
PLoS computational biology
|May 9, 2025
概括
这项研究揭示了人类运动学习在失败时优先考虑安全,在成功时优先考虑效率,从而提高生存能力. 这种适应性策略优化了运动,并减少了动态环境中的受伤风险.
科学领域:
- 发动机控制器的控制器
- 生态心理学 生态心理学
- 计算神经科学是一种神经科学.
背景情况:
- 传统的运动控制理论往往忽视了对生存至关重要的生态因素.
- 了解运动效率和伤害风险减轻的相互作用对现实世界的任务至关重要.
研究的目的:
- 引入一个新的计算运动控制模型,整合生态健康.
- 根据任务结果,研究一种平衡运动效率和安全的策略.
主要方法:
- 开发了一种结合生态健身和赢-停留/输-换班策略的计算方法.
- 实验验证使用在新奇的力扰动下坐到站起的运动.
- 雇员政策学习,内部模型调整和自适应反控制.
主要成果:
- 参与者迅速适应避免跌倒,大大降低了失败率.
- 展示了一种高水平的生态控制器,可以在安全和效率目标之间动态切换.
- 有证据支持将风险管理纳入等级化的强化学习框架.
结论:
- 人类运动学习采用了复杂的适应性策略,以平衡安全性和效率.
- 这种生态方法通过优化运动和最大限度地减少伤害来提高生存率.
- 这些发现为复杂的现实场景中的运动控制提供了新的视角.
相关概念视频
Reinforcement Schedules
116
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
116
Role of Shaping in Operant Conditioning
222
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
222
Reinforcement
154
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
154
Primary and Secondary Reinforcers
135
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
135
Law of Effect
1.3K
B.F. Skinner, a prominent figure in behavioral psychology, introduced operant conditioning by emphasizing the role of consequences in shaping behavior. This theory builds upon the law of effect proposed by Edward Thorndike, which posits that behaviors followed by satisfying outcomes are likely to be repeated. In contrast, those followed by unsatisfying outcomes are less likely to recur.
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
Edward Thorndike's foundational work involved studying learning in animals, particularly using puzzle...
1.3K
Steps in the Modeling Process
138
Albert Bandura's theory of observational learning identifies four critical processes: attention, retention, motor reproduction, and reinforcement or motivation.
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
Attention is the first necessary component for observational learning. It involves focusing on what the model is doing and saying. For example, if you decide to take a drawing class to enhance your skills, you need to pay close attention to the instructor's words and hand movements. The characteristics of the model significantly...
138


