相关实验视频
Updated: Jan 15, 2026

06:57
Pavlovian Conditioned Approach Training in Rats
Published on: February 4, 2016
11.4K
可泛化离线多目标增强学习通过偏好条件扩散器
IEEE transactions on neural networks and learning systems
|October 13, 2025
概括
基于扩散的MORL (DiffMORL) 通过使用扩散模型和数据增强来增强线下强化学习. 这种方法提高了对决策中的多样性和分布之外偏好的概括性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 强化学习是一种强化学习.
背景情况:
- 传统上,多目标强化学习 (MORL) 需要昂贵的在线互动.
- 离线MORL使用预先收集的数据集,但在将其泛化为新的偏好时遇到困难.
- 现有的方法缺乏表达力,在分布之外的偏好 (OOD) 上表现不佳.
研究的目的:
- 为线下MORL.L.引入一个可通用的基于传播的规划框架.
- 增强线下MORL技术的表达力和概括能力.
- 解决在MORL.内处理多样化和OOD偏好的局限性.
主要方法:
- 拟议的基于扩散的MORL (DiffMORL) 框架使用扩散模型.
- 实现了离线数据混合和数据增强,以改善概括性.
- 训练有素的DiffMORL以在分销和OOD偏好进行轨迹规划.
主要成果:
- 在大多数任务中,DiffMORL在D4MORL基准上取得了最先进的结果.
- 在OOD概括方面表现出卓越的表现,在18个指标中的14个指标中表现优于基线.
- 验证了框架规划所需轨迹并根据给定的偏好提取行动的能力.
结论:
- DiffMORL通过利用扩散模型来增强规划和概括,显著提升了离线MORL.
- 提出的方法有效地减轻了记忆,并通过数据增强改进了功能学习.
- DiffMORL为现实世界中的MORL应用程序提供了强大的解决方案,这些应用程序需要适应新的偏好.
相关概念视频
Reinforcement
830
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
830
Reinforcement Schedules
458
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
458
Observational Learning
832
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
832
Multi-input and Multi-variable systems
389
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
389
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K

