Related Experiment Video
Updated: Jan 7, 2026

Large Scale Energy Efficient Sensor Network Routing Using a Quantum Processor Unit
Published on: September 8, 2023
Computing power network dynamic resource scheduling integrating time series mixing dynamic state estimation and
Hong Liu1, Shulei Zhang2, Li Li1
1China Mobile Information Technology Co., Ltd., Beijing, 100033, China.
The TSL-HRL framework enhances multi-cloud resource scheduling by integrating time-series analysis and hierarchical reinforcement learning. This intelligent system improves resource utilization and real-time performance in complex cloud environments.
Area of Science:
- Cloud Computing
- Artificial Intelligence
- Resource Management
Background:
- Multi-cloud architectures present challenges in cross-cloud resource scheduling, including adapting to heterogeneous environments and slow dynamic load responses.
- Optimizing resource utilization while maintaining service quality is a critical issue in cloud management.
Purpose of the Study:
- To propose an intelligent scheduling framework, TSL-HRL, that addresses the challenges of multi-cloud resource scheduling.
- To improve resource utilization efficiency and scheduling real-time performance in dynamic multi-cloud environments.
Main Methods:
- The TSL-HRL framework integrates time-series feature modeling and hierarchical reinforcement learning.
- A time-series mixing module extracts features from resource fluctuations and demands.
- A dynamic state estimation module with Kalman filtering captures real-time resource supply and demand.
- A hierarchical reinforcement learning architecture with Q-learning (high-level) and A2C (low-level) algorithms enables collaborative decision-making.
Main Results:
- TSL-HRL effectively balanced resource utilization efficiency and scheduling real-time performance in experiments.
- The framework demonstrated robust performance on the Multi-Cloud Service Composition Dataset and Google 2019 Cluster dynamic node scenarios.
- The three-level architecture design proved effective for time-series feature extraction, dynamic state perception, and hierarchical strategy optimization.
Conclusions:
- TSL-HRL offers a systematic solution for resource management in multi-cloud environments.
- Future work includes extensions for edge-cloud collaboration, energy optimization, and meta-learning for rapid adaptation.
Related Concept Videos
Reinforcement Schedules
Once a behavior is learned,...
State Space Representation
Consider an RLC circuit, a...
Multimachine Stability
In analyzing the system, the nodal equations represent the relationship between bus voltages, machine voltages, and machine currents. The nodal equation is given by:
Sequence Networks of Rotating Machines
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Statically Indeterminate Problem Solving
Multi-input and Multi-variable systems
In the absence of...