联合计算卸载和资源分配,以通过多代理强化学习在车辆互联网中的终端协作
Cong Wang1, Yaoming Wang2, Ying Yuan2
1School of Computer and Communication Engineering, Northeastern University at Qinhuangdao, Qinhuangdao, 066004, Hebei, China; Hebei Key Laboratory of Marine Perception Network and Data Processing, Qinhuangdao, 066004, Hebei, China.
概括
本研究介绍了用于车辆边缘计算 (VEC) 的新去中心化解决方案,以有效地管理实时任务卸载和资源分配. 拟议的方法优化了资源使用,并减少了智能运输系统中的延迟.
科学领域:
- 智能运输系统 智能运输系统
- 车辆边缘计算 (VEC) 技术
- 分布式人工智能 分布式人工智能
背景情况:
- 车辆边缘计算 (VEC) 为智能运输系统提供了低延迟,但面临着资源限制和严格的延迟需求的挑战.
- 当前的VEC解决方案经常通过静态分配资源而浪费资源,而不考虑异质任务要求.
研究的目的:
- 解决VEC系统中的实时任务卸载和异质资源分配问题.
- 开发一个去中心化的解决方案,优化资源利用,尽量减少延迟.
主要方法:
- 提出了一个名为AR-MAD4PG的去中心化解决方案,利用注意力机制和反复神经网络 (RNN) 具有多代理深确定性政策梯度.
- 实现了共享代理图形,并定期进行通信,以便在边缘节点之间聚合信息.
- 设计了一个基于RNN的特征提取网络和一个多头注意力机制,以处理部分可观测性和大型状态动作空间.
主要成果:
- 拟议的AR-MAD4PG方法在模拟中显示出与现有方法相比更高的性能.
- 有效管理实时任务卸载和异质资源分配.
- 在VEC系统中提高效率和减少延迟.
结论:
- AR-MAD4PG方法提供了一个有效的去中心化解决方案,用于优化VEC中的任务卸载和资源分配.
- 该方法成功地解决了部分可观测性,异质任务和资源浪费的挑战.
- 这项工作通过高效的VEC资源管理,有助于智能交通系统的发展.
相关概念视频
01:21Distributed Loads: Problem Solving
636
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
636
01:17Rolling Resistance: Problem Solving
308
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
308
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45
01:06Collisions in Multiple Dimensions: Problem Solving
3.7K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
3.7K
01:23Reinforcement
192
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
192
01:22Multi-input and Multi-variable systems
105
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
105