在线强化学习算法的奖励设计,支持口腔自我护理
Anna L Trella1, Kelly W Zhang1, Inbal Nahum-Shani2
1Department of Computer Science, Harvard University.
概括
这项研究引入了一种新的在线强化学习 (RL) 算法,以优化基于移动的提示,以改善口腔卫生. 该算法旨在通过个性化,及时的鼓励来增强牙科自我护理,有效地预防牙科疾病.
科学领域:
- 医疗信息学 医疗信息学
- 人工智能在医学中的应用
- 行为科学 行为科学
背景情况:
- 牙疾病是可以预防的,但患者对口腔卫生建议的坚持往往很差.
- 需要个性化,及时的干预措施来鼓励一致的口腔自我护理行为.
- 移动健康 (mHealth) 平台为提供此类干预提供了可扩展的解决方案.
研究的目的:
- 开发和评估一个在线强化学习 (RL) 算法,以优化基于移动的提示,以改善口腔卫生.
- 为了应对延迟效应和杂,稀疏数据在现实世界mHealth设置中的挑战.
- 设计一个奖励函数,以平衡所需的健康结果与用户负担.
主要方法:
- 为移动医疗应用量身定制的在线强化学习 (RL) 算法的开发.
- 设计一种质量奖励功能,以最大限度地提高刷毛质量并最大限度地降低用户负担.
- 创建一个模拟环境测试台,以优化RL超参数.
- 在Oralytics移动健康研究中部署RL算法.
主要成果:
- 开发的RL算法有效地优化了口腔自我护理的激励信息的传递.
- 质量奖励功能成功地平衡了健康结果和用户体验.
- 模拟测试台提供了一个强大的超参数调整方法.
- Oralytics是第一个使用RL用于通过优化消息传递来预防牙科疾病的mHealth研究.
结论:
- 在线强化学习为mHealth中的个性化行为改变干预提供了一个有希望的方法.
- 通过RL优化激励信息可以显著提高对口腔卫生实践的遵守.
- 这项工作为未来的mHealth干预措施奠定了基础,利用人工智能预防慢性疾病.
相关概念视频
Reinforcement
274
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
274
Reinforcement Schedules
203
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
203
Primary and Secondary Reinforcers
297
In psychology, reinforcement is a key concept in behavior modification. B.F. Skinner demonstrated this with his experiments involving rats in what is known as a Skinner box. The rats learned to press a lever to receive food, a primary reinforcer that fulfilled their innate need for nourishment.
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
Effective reinforcers for humans vary depending on the individual and the context. Primary reinforcers, such as food, water, sleep, shelter, and pleasure, have inherent value and satisfy basic biological...
297
Operant Conditioning Intervention
80
Operant conditioning serves as a foundational principle in therapeutic interventions aimed at modifying maladaptive behaviors. Central to this approach is the notion that behaviors, both adaptive and maladaptive, are learned through reinforcement. By analyzing the environmental factors that reinforce problematic behaviors, clinicians can design interventions to weaken these reinforcements and replace maladaptive behaviors with healthier alternatives.
In operant conditioning, behaviors that are...
In operant conditioning, behaviors that are...
80
Timing and Consequences on Behavior
119
In operant conditioning, the timing of reinforcement is crucial. For animals like rats and cats, immediate reinforcement (within a few seconds) is much more effective than delayed reinforcement. For example, a food reward for a rat needs to follow within 30 seconds of pressing a bar to be effective.
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
Humans, however, can respond to delayed reinforcers. We often make decisions between immediate small rewards and delayed larger rewards. This ability to delay gratification is a significant...
119
Operant Conditioning
1.7K
Operant conditioning, a key concept in behavioral psychology, involves using reinforcement and punishment to alter the likelihood of a behavior being repeated. B.F. introduced this type of conditioning. Skinner focused on voluntary behaviors and the consequences that follow them, influencing whether these behaviors will be strengthened or diminished.
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
Reinforcement in operant conditioning can be positive or negative, both of which serve to increase the likelihood of a behavior. Positive...
1.7K


