深度强化学习用于优化IEEE 802.11ah MAC层中的受限制访问窗口.
Xiaojun Jiang1,2, Shimin Gong1,2, Chengyi Deng1
1School of Intelligent Systems Engineering, Shenzhen Campus of Sun Yat-Sen University, Shenzhen 518107, China.
Sensors (Basel, Switzerland)
|May 25, 2024
概括
在IEEE 802.11ah网络中使用近接策略优化 (PPO) 优化受限制访问窗口 (RAW) 参数可以显著提高物联网 (IoT) 吞吐量. 这种深度强化学习方法在动态条件下提高网络效率.
科学领域:
- 无线通信网络 无线通信网络
- 物联网 (IoT) 的物联网 (IoT) 的物联网.
- 网络性能优化 网络性能优化
背景情况:
- IEEE 802.11ah 标准解决了物联网应用程序日益扩大的规模.
- 在MAC层中的受限制访问窗口 (RAW) 机制管理多个站点,以减少争议并提高能源效率.
- 优化RAW参数 (组,槽,持续时间) 对于网络性能至关重要.
研究的目的:
- 为基于IEEE 802.11ah的上链物联网网络优化RAW参数配置.
- 通过解决RAW参数优化问题来提高网络吞吐量.
- 提出一种可靠的方法来确定在复杂和动态网络条件下首选的RAW参数.
主要方法:
- 制定了一个RAW参数优化问题,以提高网络吞吐量.
- 提出了深度强化学习 (DRL) 方法,特别是近接政策优化 (PPO),以确定最佳的RAW参数.
- 在NS-3模拟器中验证了基于PPO的算法,使用周期性和随机流量模式.
主要成果:
- 基于PPO的DRL算法在各种网络条件下成功获得了优化的RAW参数.
- 使用拟议的优化方法证明了网络吞吐量的显著改善.
- 该算法在提高学习效率和稳定性方面表现出有效性.
结论:
- 基于PPO的DRL方法为IEEE 802.11ah物联网网络中优化RAW参数提供了有效的解决方案.
- 优化RAW参数导致网络吞吐量大幅增加.
- 这种方法为管理争议和改善大规模物联网部署中的性能提供了有希望的策略.
相关概念视频
Long-term Potentiation
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre- and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Long-term Potentiation
Long-term potentiation, or LTP, is one of the ways by which synaptic plasticity—changes in the strength of chemical synapses—can occur in the brain. LTP is the process of synaptic strengthening that occurs over time between pre and postsynaptic neuronal connections. The synaptic strengthening of LTP works in opposition to the synaptic weakening of long-term depression (LTD) and together are the main mechanisms that underlie learning and memory.
Hebbian LTP
LTP can occur when presynaptic neurons...
Hebbian LTP
LTP can occur when presynaptic neurons...
Methods of Medium Optimization
Optimizing growth media enhances microbial proliferation and maximizes product yield. Statistical experimental design methodologies provide structured and reproducible approaches, offering progressively higher levels of robustness and efficiency.The One-Factor-at-a-Time (OFAT) MethodThe One-Factor-at-a-Time (OFAT) method involves adjusting a single variable while keeping all others constant. However, it cannot detect interactions between variables, often leading to suboptimal outcomes when...
iChip
The cultivation of environmental microorganisms has long been hindered by the inability to replicate complex native conditions in vitro. The isolation chip (iChip) addresses this limitation by facilitating the growth of previously uncultivable microorganisms through in situ incubation. Designed for high-throughput microbial cultivation, the iChip comprises hundreds of microchambers, each capable of housing a single microbial cell. These microchambers are loaded with a mixture of molten agar and...


