Related Experiment Video
Updated: Sep 29, 2025

05:30
Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
673
Dynamic Data Streams for Time-Critical IoT Systems in Energy-Aware IoT Devices Using Reinforcement Learning.
Fawzy Habeeb1,2, Tomasz Szydlo3, Lukasz Kowalski3
1School of Computing, Newcastle University, Newcastle upon Tyne NE1 7RU, UK.
Sensors (Basel, Switzerland)
|March 26, 2022
Summary
This study introduces a reinforcement learning (RL) approach for energy-aware Internet of Things (IoT) devices. The method optimizes data transmission based on available renewable energy, extending sensor battery life and increasing data transmission by 23%.
Area of Science:
- IoT Systems
- Energy Efficiency
- Machine Learning
Background:
- Energy-aware sensors are crucial for various monitoring applications.
- Extending sensor lifetime requires energy-efficient solutions for time-critical data.
Purpose of the Study:
- To propose a reinforcement learning (RL) based dynamic data stream solution for energy-aware IoT devices.
- To enhance data reliability and sensor battery lifetime in time-critical IoT systems.
Main Methods:
- Utilized the Q-Learning algorithm, a reinforcement learning technique.
- Developed a mechanism to dynamically adjust data transport rates based on available renewable energy.
Main Results:
- The proposed solution demonstrated an increase in transmitted data by up to 23%.
- Ensured continuous operation of IoT devices by balancing data transmission and energy availability.
Conclusions:
- Reinforcement learning effectively manages energy resources in IoT devices.
- The Q-Learning based approach enhances data transmission efficiency and device longevity.
Related Concept Videos
Reinforcement Schedules
249
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
249
Reinforcement
400
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
400
Distributed Loads: Problem Solving
769
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
769
Linear time-invariant Systems
499
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
499
Rapidly Varying Flow
156
Rapidly varying flow (RVF) in open channels is characterized by abrupt changes in flow depth over a short distance, with the rate of depth change relative to distance often approaching unity. These flows are inherently complex due to their transient and multi-dimensional nature, making exact analysis difficult. However, approximate solutions using simplified models provide valuable insights into their behavior.Key Features of Rapidly Varying FlowRVF is commonly observed in scenarios involving...
156
Observational Learning
349
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
349
