简化深度强化学习方法用于电源域NOMA系统中的通道预测
Mohamed Gaballa1, Maysam Abbod1
1Department of Electronic and Electrical Engineering, Brunel University London, Uxbridge UB8 3PH, UK.
Sensors (Basel, Switzerland)
|November 14, 2023
概括
本研究介绍了一种简化的深度Q网络 (DQN) 算法,用于在电源域非直角多重访问 (PD-NOMA) 系统中准确预测通道参数. DQN方法提高了下游链路总和率,并在道估计中优于基准方法.
科学领域:
- 无线通信无线通信
- 机器学习 机器学习
- 信号处理 信号处理
背景情况:
- 准确的通道状态信息对于优化电源域非直角多个接入 (PD-NOMA) 系统的性能至关重要.
- 传统的通道估计方法可能是计算密集型的,可能无法有效地适应动态无线环境.
- 深度强化学习 (DRL) 为复杂的通信系统中的智能资源管理和预测提供了一个有希望的途径.
研究的目的:
- 调查深度强化学习 (DRL) 的有效性,特别是深度Q网络 (DQN) 算法,用于预测PD-NOMA系统中的通道参数.
- 开发一个简化的DQN模型,用于高效的通道系数估计,以最大限度地提高所有用户的下游链路总和率.
- 探索基于DQN的通道估计与功率分配政策的整合,以加强多用户检测.
主要方法:
- 开发了一个深度Q网络 (DQN) 算法,并集成到PD-NOMA系统中,用于通道参数预测.
- 该DQN模型是用随机道统计数据初始化,并通过与系统环境的交互动态更新.
- 建议的方法与基准方案进行了评估,包括基于DNN的LSTM,Q-learning和MMSE,使用各种绩效指标.
主要成果:
- 与基准方法相比,简化的DQN算法在道参数估计方面表现出竞争力.
- DQN方法有效地估计了通道系数,使得在接收器上能够准确地恢复数据.
- 集成基于DQN的通道估计和功率分配,提高了多用户检测能力.
结论:
- 建议的简化DQN算法是PD-NOMA系统中通道参数估计的可行和高效方法.
- DRL,特别是DQN,通过优化道预测和多用户检测,提供了一种强大的工具来提高系统性能.
- 开发的DQN方案有助于最大限度地提高下游链路总和率,并提高PD-NOMA的整体系统效率.
相关概念视频
Maximum Power Flow and Line Loadability
120
The maximum power flow for lossy transmission lines is derived using ABCD parameters in phasor form. These parameters create a matrix relationship between the sending-end and receiving-end voltages and currents, allowing the determination of the receiving-end current. This relationship facilitates calculating the complex power delivered to the receiving end, from which real and reactive power components are derived.
120
Maximum Power Transfer
265
Numerous practical applications within engineering disciplines, such as telecommunications, necessitate optimizing power delivery to a connected load. This pursuit, however, entails inherent internal losses, which can either equal or exceed the power supplied to the load. The Thevenin equivalent circuit is helpful in finding the maximum power a linear circuit can deliver to a load. It is assumed in this context that the load resistance can be adjusted.
By substituting the entire circuit with...
By substituting the entire circuit with...
265
Linear Approximation in Frequency Domain
94
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
94
Linear Approximation in Time Domain
84
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
84
State Space Representation
213
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
213
Transfer Function to State Space
269
State-space representation is a powerful tool for simulating physical systems on digital computers, necessitating the conversion of the transfer function into state-space form. Consider an nth-order linear differential equation with constant coefficients, like those encountered in an RLC circuit. The state variables are selected as the output and its n−1 derivatives. Differentiating these variables and substituting them back into the original equation produces the state equations.
In an...
In an...
269


