基于深度强化学习的NR-V2X系统中信息时代和能源消耗的联合优化
Shulin Song1,2, Zheng Zhang1,2, Qiong Wu1,2
1School of Internet of Things Engineering, Jiangnan University, Wuxi 214122, China.
Sensors (Basel, Switzerland)
|July 13, 2024
概括
新的5G自动驾驶技术通过减少数据延迟和能源消耗来改善车辆通信. 这种5G新无线电 (NR) 车辆到一切 (V2X) 系统使用深度强化学习来实现最佳性能.
科学领域:
- 无线通信技术无线通信技术
- 自动驾驶系统 自动驾驶系统
- 下一代移动网络是下一代移动网络
背景情况:
- 自动驾驶在很大程度上依赖于可靠,低延迟的无线通信.
- 5G新无线电 (NR) 车辆到一切 (V2X) 技术增强了直接车辆到车辆通信 (模式2侧链).
- 现有的NR-V2X模式2面临资源碰撞问题,降低了信息时代 (AoI).
研究的目的:
- 为了减轻资源碰撞,并在NR-V2X模式2中改善AOI.
- 优化AoI和通信能源消耗之间的权衡.
- 开发一个高效的算法来管理NR-V2X通信参数.
主要方法:
- 与NR-V2X集成非直角多重接入 (NOMA),以取消干扰.
- 考虑AOI和能源消耗的优化问题的制定.
- 应用深度强化学习 (DRL) 来确定最佳的资源保留间隔 (RRI) 和传输功率.
主要成果:
- 拟议的DRL算法有效地降低了发射车辆的能源消耗.
- 该算法成功地将接收车辆的AoI降到最低.
- 模拟证实了开发方法的卓越性能.
结论:
- 将NR-V2X与NOMA结合起来,并采用DRL,为可靠的自动驾驶通信提供了一个有前途的解决方案.
- 对AoI和能源消耗的联合优化对于高效的V2X系统至关重要.
- 基于DRL的方法为在动态环境中管理V2X通信参数提供了有效的策略.
相关概念视频
Reinforcement Schedules
140
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
140
Reinforcement
202
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
202
Rolling Resistance: Problem Solving
319
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
319
Energy Conservation and Bernoulli's Equation
8.9K
Applying the conservation of energy principle or the work-energy theorem to an incompressible, inviscid fluid in laminar, steady, irrotational flow leads to Bernoulli's equation. It states that the sum of the fluid pressure, potential, and kinetic energy per unit volume is constant along a streamline.
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
All the terms in the equation have the dimension of energy per unit volume. The kinetic energy per unit volume is called the kinetic energy density, and the potential energy per unit volume is...
8.9K
Multi-input and Multi-variable systems
105
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
105
Mechanical Efficiency of Real Machines
669
The mechanical efficiency of a machine is a fundamental concept that describes how effectively a machine can convert input work into output work. According to this concept, the efficiency of a machine is equal to the ratio of the output work to the input work. An ideal machine, meaning a machine that has no energy losses, has an efficiency of one. This implies that the input work and the output work are equal.
However, in reality, no machine can be truly ideal, and all of them experience some...
However, in reality, no machine can be truly ideal, and all of them experience some...
669


