Related Experiment Video
Updated: Aug 14, 2026

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
Blockage-Aware Power Allocation Algorithm for Millimeter-Wave Communication with Dynamic Reward Q-Learning
1Faculty of Science and Engineering, The University of Manchester, Oxford Rd., Manchester M13 9PL, UK.
Abstract:
Millimeter-wave (mmWave) communication systems are vulnerable to severe attenuation, blockage-induced LOS/NLOS transitions, and time-varying co-channel interference. This paper develops a lightweight distributed power-allocation framework in which each base station independently updates a tabular Q-learning policy using locally observable blockage-ratio, serving-distance, and aggregate-interference information. The proposed state-dependent dynamic reward is recalculated at every decision step, and its coefficients vary explicitly with the instantaneous blockage ratio, QoS satisfaction ratio, and normalized interference level. All learning-based and non-learning baselines are evaluated using the same topology realizations, blockage and mobility traces, and random seeds. Under the reconstructed simulation settings, the proposed method achieves performance comparable to fixed Q-learning while retaining a transparent blockage-aware state and low-complexity distributed implementation. DQN, greedy, and uniform power achieve higher raw capacity or QoS in the considered small-scale network. Results from 30 paired runs with 95% confidence intervals, together with ablation, sensitivity, beam-misalignment, and overhead analyses, clarify the empirical benefits, limitations, and deployment scope of the proposed method. The study focuses on power control after beam establishment; joint beam tracking and power allocation remain outside the present scope.
Related Concept Videos
Fast Decoupled and DC Powerflow
Ampere-Maxwell's Law: Problem-Solving
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of the problem,...