Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Aug 10, 2025

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
05:30

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Published on: September 8, 2023

628

Deep-Q-Network-Based Packet Scheduling in an IoT Environment.

Xing Fu1, Jeong Geun Kim1

  • 1Department of Electrical Engineering, College of Electronics and Information, Kyung Hee University, Yongin 17104, Republic of Korea.

Sensors (Basel, Switzerland)
|February 11, 2023
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

Network Function of a Circuit01:25

Network Function of a Circuit

341
Frequency response analysis in electrical circuits provides vital insights into a circuit's behavior as the frequency of the input signal changes. The transfer function, a mathematical tool, is instrumental in understanding this behavior. It defines the relationship between phasor output and input and comes in four types: voltage gain, current gain, transfer impedance, and transfer admittance. The critical components of the transfer function are the poles and zeros.
341
Short-distance Transport of Resources02:12

Short-distance Transport of Resources

16.3K
Short-distance transport refers to transport that occurs over a distance of just 2-3 cells, crossing the plasma membrane in the process. Small uncharged molecules, such as oxygen, carbon dioxide, and water, can diffuse across the plasma membrane on their own. In contrast, ions and larger molecules require the assistance of transport proteins due to their charge or size. Transport across membranes also occurs within individual cells, playing a variety of essential roles for the plant as a whole.
16.3K
Rapidly Varying Flow01:24

Rapidly Varying Flow

119
Rapidly varying flow (RVF) in open channels is characterized by abrupt changes in flow depth over a short distance, with the rate of depth change relative to distance often approaching unity. These flows are inherently complex due to their transient and multi-dimensional nature, making exact analysis difficult. However, approximate solutions using simplified models provide valuable insights into their behavior.Key Features of Rapidly Varying FlowRVF is commonly observed in scenarios involving...
119
IP3/DAG Signaling Pathway01:11

IP3/DAG Signaling Pathway

12.3K
Membrane lipids such as phosphatidylinositol (PI) are precursors for several membrane-bound and soluble second messengers. Specific kinases phosphorylate PI and produce phosphorylated inositol phospholipids. One such inositol phospholipids are the  phosphatidylinositol-4,5 bisphosphate [PI(4,5)P2], present in the inner half of the lipid bilayer. Upon ligand binding, GPCR stimulates Gq proteins to turn on phospholipase Cꞵ. Activated phospholipase Cꞵ cleaves PI(4,5)P2 and...
12.3K
Maximum Power Flow and Line Loadability01:23

Maximum Power Flow and Line Loadability

155
The maximum power flow for lossy transmission lines is derived using ABCD parameters in phasor form. These parameters create a matrix relationship between the sending-end and receiving-end voltages and currents, allowing the determination of the receiving-end current. This relationship facilitates calculating the complex power delivered to the receiving end, from which real and reactive power components are derived.
155
Uniform Depth Channel Flow: Problem Solving01:18

Uniform Depth Channel Flow: Problem Solving

107
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
107

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same journal

RETRACTED: Zhang et al. A Novel Framework for Reconstruction and Imaging of Target Scattering Centers via Wide-Angle Incidence in Radar Networks. <i>Sensors</i> 2025, <i>25</i>, 6802.

Sensors (Basel, Switzerland)·2026
Same journal

Enhancing Unsupervised Multi-Source Domain Adaptation for Person Re-Identification via Mixture of Experts and Graph-Based Relation.

Sensors (Basel, Switzerland)·2026
Same journal

Development of an Instrumented Glove for Palmar Pressure Assessment in Kayakers.

Sensors (Basel, Switzerland)·2026
Same journal

Development and Experimental Validation of an Autonomous IoT-Based Monitoring System for Real-Time Water Quality Assessment in the Amazon River.

Sensors (Basel, Switzerland)·2026
Same journal

Semi-Supervised Adversarial Learning Framework for Controller Area Network Bus Intrusion Detection.

Sensors (Basel, Switzerland)·2026
Same journal

Smart Optimization Method for Safety Signs in Innovative Manufacturing Environments Integrating Industrial Field IoT Sensors and Knowledge Graphs.

Sensors (Basel, Switzerland)·2026
See all related articles

This study introduces a Deep Q-Network (DQN) packet scheduling algorithm for the Internet of Things (IoT). The algorithm optimizes energy efficiency and network lifetime by dynamically adjusting device transmissions, ensuring quality of service.

Area of Science:

  • Computer Science
  • Electrical Engineering
  • Network Engineering

Background:

  • The proliferation of Internet of Things (IoT) devices necessitates energy-efficient solutions for wireless sensor nodes.
  • Effective resource scheduling is crucial for managing the complexity and energy consumption of IoT networks.
  • Existing methods struggle to dynamically adapt to varying network conditions.

Purpose of the Study:

  • To develop a practical Deep Q-Network (DQN)-based packet scheduling algorithm for coordinating multiple IoT devices.
  • To enhance energy efficiency and prolong the operational lifetime of wireless sensor networks.
  • To analyze the DQN scheduler's policy for deeper insights into optimized resource allocation.

Main Methods:

  • Implementation of a Deep Q-Network (DQN) algorithm for packet scheduling.
Keywords:
BLEIoTdeep Q-networkenergy efficiencyreinforcement learningwireless sensor network

More Related Videos

Integration of 5G Experimentation Infrastructures into a Multi-Site NFV Ecosystem
10:15

Integration of 5G Experimentation Infrastructures into a Multi-Site NFV Ecosystem

Published on: February 3, 2021

3.8K
Automated Deployment of an Internet Protocol Telephony Service on Unmanned Aerial Vehicles Using Network Functions Virtualization
07:49

Automated Deployment of an Internet Protocol Telephony Service on Unmanned Aerial Vehicles Using Network Functions Virtualization

Published on: November 26, 2019

8.1K

Related Experiment Videos

Last Updated: Aug 10, 2025

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
05:30

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit

Published on: September 8, 2023

628
Integration of 5G Experimentation Infrastructures into a Multi-Site NFV Ecosystem
10:15

Integration of 5G Experimentation Infrastructures into a Multi-Site NFV Ecosystem

Published on: February 3, 2021

3.8K
Automated Deployment of an Internet Protocol Telephony Service on Unmanned Aerial Vehicles Using Network Functions Virtualization
07:49

Automated Deployment of an Internet Protocol Telephony Service on Unmanned Aerial Vehicles Using Network Functions Virtualization

Published on: November 26, 2019

8.1K
  • Dynamic adjustment of connection intervals (CI) and packet transmission counts per node.
  • Experimental validation of the proposed scheduler's performance in diverse network environments.

    • Main Results:

    • The DQN-based scheduler significantly improves energy efficiency in dynamic network settings.
    • The algorithm effectively handles time-varying network conditions.
    • The proposed method prolongs network lifetime while maintaining quality of service (QoS).

    Conclusions:

    • The proposed DQN packet scheduling algorithm offers a practical and effective solution for energy-efficient IoT networks.
    • Dynamic adjustment of transmission parameters is key to optimizing performance in fluctuating environments.
    • This approach provides a robust method for extending the lifespan of IoT networks.