Related Experiment Video
Updated: Nov 26, 2025

05:30
Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
948
Fog Fragment Cooperation on Bandwidth Management Based on Reinforcement Learning
Motahareh Mobasheri1, Yangwoo Kim1, Woongsup Kim1
1Information and Communication Engineering Department, Dongguk University, Seoul 04620, Korea.
Sensors (Basel, Switzerland)
|December 9, 2020
Summary
This study introduces fog fragment computing to manage bandwidth constraints in the Internet of Things (IoT). By using cooperative fog nodes and Q-learning, it efficiently handles emergency data transmission.
Area of Science:
- Computer Science
- Network Engineering
- Artificial Intelligence
Background:
- The Internet of Things (IoT) generates vast amounts of data, overwhelming network bandwidth.
- Slower bandwidth improvements create bottlenecks, necessitating solutions for efficient data management.
- The proliferation of smart environments and IoT devices increases the demand on network infrastructure.
Purpose of the Study:
- To introduce fog fragment computing as an alternative to conventional fog computing.
- To address bandwidth management challenges in IoT environments, especially for devices with emergencies.
- To develop a cooperative strategy for fog nodes to overcome bandwidth limitations.
Main Methods:
- Formulating the fog node decision-making problem using a reinforcement learning approach.
- Developing a Q-learning algorithm to enable cooperative decision-making among fog nodes.
- Comparing the proposed fog fragment computing method with a single fog node scenario.
Main Results:
- The proposed fog fragment computing method demonstrates superior performance compared to a single fog node approach.
- Cooperative fog nodes effectively manage bandwidth for IoT devices with urgent data needs.
- The Q-learning algorithm facilitates efficient resource allocation and decision-making.
Conclusions:
- Fog fragment computing offers a viable solution for bandwidth constraints in IoT networks.
- Cooperative strategies among fog nodes, guided by reinforcement learning, are crucial for efficient IoT data management.
- This research presents a novel approach to enhance IoT network performance under high data load conditions.
Related Concept Videos
Reinforcement
625
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
625
Reinforcement Schedules
340
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
340
Observational Learning
655
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
655
Associative Learning
895
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
895
Distributed Loads: Problem Solving
933
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
933
Cognitive Learning
868
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
868