深度Q管理:多目标深度强化学习的新框架
Richardson Menezes1,2, Thiago Henrique Freire de Oliveira3, Luiz Paulo de Souza Medeiros1
1Postgraduate Program in Electrical and Computer Engineering, Federal University of Rio Grande do Norte, Natal, Brazil.
Frontiers in artificial intelligence
|December 18, 2025
概括
深度Q-管理,一个新的多目标强化学习 (MORL) 算法,发现所有的帕雷托前线政策. 它使用深度学习来增强在决定性环境中的多目标优化.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 强化学习是一种强化学习.
背景情况:
- 多目标优化带来了诸如维度和高估偏差的诅咒等挑战.
- 现有的算法在复杂场景中难以有效地识别整个帕雷托前线.
研究的目的:
- 介绍Deep Q-Managed,一个新的多目标强化学习 (MORL) 算法.
- 允许发现帕雷托阵线内的所有政策.
- 使用深度学习技术增强多目标优化.
主要方法:
- 将深度学习技术,特别是双重和决斗网络集成到MORL框架中.
- 通过先进的网络架构减轻维度和高估偏差.
- 将算法应用于决定性的情节性环境.
主要成果:
- 深度Q管理成功地实现了跨各种帕雷托前线复杂性 (凸起,,混合) 的非主导的多目标政策.
- 在标准MORL基准 (DST,BST,MBST) 上始终达到最大超量值.
- 证明能够有效地定位所有帕雷托前线点.
结论:
- 深度Q-Managed是一种熟练的算法,用于在决定性设置中发现全面的帕雷托前线.
- 该算法在机器人,金融和医疗保健领域的应用中显示出强度和多功能性.
- 未来的工作将集中在将算法扩展到随机环境上.
相关概念视频
Multi-input and Multi-variable systems
373
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
373
Reinforcement Schedules
436
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
436
Reinforcement
786
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
786
Observational Learning
791
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
791
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
261
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
261
Collisions in Multiple Dimensions: Problem Solving
5.2K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
5.2K
