通过基于上下文模型的强化学习实现基于人工智能的精确康复
Dongze Ye1, Haipeng Luo1, Carolee Winstein2
1Computer Science, University of Southern California, Los Angeles, CA, USA.
Journal of neuroengineering and rehabilitation
|December 19, 2025
概括
这项研究介绍了一个使用强化学习来个性化中风康复计划的AI系统. 人工智能系统不断改进治疗时间,剂量和强度,以获得更好的患者结果.
科学领域:
- 神经科学是一个神经科学.
- 康复医学 康复医学 康复医学
- 人工智能的人工智能
背景情况:
- 由于病变,恢复轨迹和治疗反应的差异,中风恢复有很大差异.
- 精准医学对于优化中风恢复至关重要,因为它通过根据患者个体需求量身定制干预措施.
- 当前的人工智能 (AI) 系统缺乏个性化和持续调整中风后康复计划的能力.
研究的目的:
- 开发一种基于人工智能的新型决策支持系统,用于精确康复中风患者.
- 个性化连续治疗计划,包括时间,剂量和强度,以最大限度地提高患者的长期结果.
- 创建一个与临床医生和患者合作的系统,根据判断,约束和偏好来定制康复.
主要方法:
- 使用了上下文马尔科夫决策过程 (CMDP) 框架.
- 开发了一种基于贝叶斯模型的新型层次化的强化学习 (RL) 算法,用于上下文RL (PSCRL) 的后端采样.
- 该算法平衡了利用和探索,以发现和调整接近最佳的顺序处理,同时尊重约束.
主要成果:
- 人工智能系统使用模拟与150个不同的合成患者进行了实施和验证.
- 该系统通过贝叶斯等级建模,从当前的患者数据和过去的患者数据库中展示了持续的学习.
- 人工智能驱动的适应性治疗与非适应性的"一刀切"方法相比,显著改善了功能收益.
结论:
- 开发的基于人工智能的精确康复系统显示了将其整合到学习健康系统中的潜力.
- 这种新的方法,利用基于上下文模型的RL,可以推进个性化中风康复.
- 该系统适应治疗的能力为改善中风恢复结果提供了一个有希望的方向.
相关概念视频
Operant Conditioning Intervention
433
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
433
Modeling in Therapy
364
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
364
Observational Learning
791
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
791
Reinforcement
786
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
786
Reinforcement Schedules
436
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
436
Behavior Modification
521
Behavioral approaches have often been criticized for ignoring mental processes and focusing solely on observable behavior. However, these approaches provide an optimistic perspective for individuals seeking to change their behaviors. Rather than concentrating on intrinsic personality traits, behavioral approaches suggest that even longstanding habits can be modified by changing the reward contingencies that maintain them.
A real-world application of operant conditioning principles is applied...
A real-world application of operant conditioning principles is applied...
521


