实现多个AGV的节能路由,使用多个代理强化学习
Xianfeng Ye1, Zhiyun Deng1, Yanjun Shi2
1School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China.
Sensors (Basel, Switzerland)
|July 8, 2023
概括
本研究引入了一种新的多代理强化学习算法,用于优化自动引导车辆 (AGV) 的路线,以减少能源消耗. 这种新的方法提高了任务分配和路径规划,以提高AGV运营的能源效率.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
- 运营研究 运营研究
背景情况:
- 自动引导车辆 (AGV) 对物流和制造自动化至关重要.
- 优化AGV调度和路由是复杂的,能源效率经常被忽视.
- 现有的方法可能无法充分解决AGV系统的动态和多代理性质.
研究的目的:
- 为高效的AGV调度和路由开发一个多代理强化学习 (MARL) 算法.
- 为了最大限度地减少多AGV操作的整体能源消耗.
- 增强AGV任务分配和路径规划能力.
主要方法:
- 该研究提出了一种针对 AGV 环境量身定制的多代理深度决定性政策梯度 (MADDPG) 算法.
- 一个专门的奖励功能旨在优先考虑能源效率.
- 集成了e-greedy探索战略,以改善培训的融合和绩效.
主要成果:
- 拟议的MARL算法有效地解决了多AGV任务分配和路径规划的挑战.
- 数字实验表明,与基线方法 (MADDPG,Q-Learning) 相比,能源效率更高.
- 该算法成功地平衡了勘探和开发,以实现更快的融合和更好的性能.
结论:
- 开发的MARL算法在节能AGV运行方面取得了重大进展.
- 该方法为动态环境中复杂的调度和路由问题提供了强大的解决方案.
- 这项研究有助于实现更可持续,更高效的自动化物流系统.
相关概念视频
Rolling Resistance: Problem Solving
383
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
383
Collisions in Multiple Dimensions: Problem Solving
4.3K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.3K
Multi-input and Multi-variable systems
132
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
132
Distributed Loads: Problem Solving
678
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
678
Reinforcement
282
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
282
Hierarchy of Motor Control
2.9K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.9K


