Related Experiment Videos
UAV-asisted IoT network framework with hybrid deep reinforcement and federated learning
Andreas Andreou1, Constandinos X Mavromoustakis2, Evangelos Markakis3
1Department of Computer Science, University of Nicosia, 46 Makedonitissas Avenue, 1700, Nicosia, Cyprus. andreou.andreas@unic.ac.cy.
Abstract:
This paper addresses a critical gap in Unmanned Aerial Vehicle (UAV)-assisted Internet of Things (IoT) networks, where existing works inadequately integrate UAV deployment optimization with privacy-preserving Federated Learning (FL) and adaptive resource allocation under dynamic network conditions. The research explores the deployment of multi-UAV networks in IoT environments, emphasizing their dual roles in expanding cellular network coverage and facilitating efficient data collection. Unlike prior studies that treat UAV placement and FL-driven resource optimization separately, we present a unified hybrid framework leveraging Deep Reinforcement Learning (DRL) and FL. The proposed framework incorporates the Multi-UAV Network Formation (MUNF) algorithm, which employs Particle Swarm Optimization (PSO) to improve the Signal-to-Noise Ratio (SNR) for effective data collection. Additionally, the Dynamic Adaptive Strategy (DAS) utilizes a Deep Deterministic Policy Gradient (DDPG) approach to optimize resource allocation, reduce latency, and enhance throughput. Extensive simulations demonstrate a 26% increase in data throughput, an 18% reduction in latency, and more stable SNR distribution compared to state-of-the-art baselines. These results indicate a consistent improvement in network efficiency and scalability, validating the proposed framework's capability to address real-world UAV-assisted IoT challenges more effectively than prior work.
Related Concept Videos
Associative Learning
Classical conditioning, also known...
Observational Learning
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Introduction to Learning
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
Cognitive Learning
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...