用户配对用于基于NOMA的延迟有限的卫星网络,具有深度强化学习
Qianfeng Zhang1,2, Kang An3, Xiaojuan Yan1,4
1Guangxi Key Laboratory of Ocean Engineering Equipment and Technology, Qinzhou 535011, China.
Sensors (Basel, Switzerland)
|August 26, 2023
概括
本研究引入了深度强化学习 (DRL) 方法,用于在非直角多重访问 (NOMA) 卫星网络中实现最佳的用户配对. DRL方法提高了资源利用率和性能,以满足各种服务质量 (QoS) 要求.
科学领域:
- 卫星通信 卫星通信
- 无线网络 无线网络 无线网络
- 网络优化 网络优化
背景情况:
- 非直角多重接入 (NOMA) 能够在卫星网络中有效共享资源.
- 不同的服务质量 (QoS) 要求,特别是延迟约束,对NOMA的性能构成挑战.
- 有效容量是评估在延迟有限的QoS下性能的一个关键指标.
研究的目的:
- 为了解决电源域NOMA卫星网络中的用户配对问题,具有多种延迟 QoS 要求.
- 通过有效地组建NOMA用户对来优化资源利用和网络性能.
- 开发一个动态的用户选择策略,克服传统方法的难以处理.
主要方法:
- 利用有效能力来建模延迟 QoS 对性能的影响.
- 确定了功率分配系数,以保持对延迟敏感用户的性能,而不是与正角多重接入 (OMA) 相比.
- 采用深度强化学习 (DRL) 算法,在延迟有限的NOMA场景中进行动态和最佳的用户选择.
主要成果:
- DRL算法成功地确定了每个州NOMA的最佳用户配对.
- 与随机选择和OMA相比,拟议的基于DRL的方案显示出更高的性能.
- 该方法有效地管理了通道条件,并延迟了用户配对的 QoS 要求.
结论:
- 基于DRL的用户选择方案为优化NOMA卫星网络提供了有效的解决方案.
- 这种方法通过基于 QoS 和通道条件的动态配对用户来显著提高性能.
- 这些发现凸显了DLR在推进复杂无线网络管理方面的潜力.
相关概念视频
Reinforcement Schedules
203
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
203
Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209
Avoidance Learning and Learned Helplessness
1.8K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.8K
Reinforcement
274
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
274
Associative Learning
439
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
439
Real-World Application of Classical Conditioning
624
Classical conditioning not only includes the initial pairing of stimuli but also extends to more complex forms, such as higher-order conditioning. Higher-order conditioning involves creating associations beyond the primary conditioned stimulus, resulting in a chain of conditioned responses.
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
Higher-order, or second-order, conditioning occurs when a neutral stimulus becomes associated with an already established conditioned stimulus through repeated pairings. For instance, if a dog has been...
624


