Priority-Aware Actuation Update Scheme in Heterogeneous Industrial Networks.

Area of Science:

• Wireless Networked Control Systems (WNCS)
• Information Theory
• Control Theory

Background:

• Age of Information (AoI) and actuation update costs are key metrics in WNCS.
• Opportunistic WiFi updates reduce monetary cost but increase AoI.
• Varying AoI requirements based on control priorities necessitate tailored update strategies.

Purpose of the Study:

• To propose a Priority-Aware Actuation Update Scheme (PAUS) for WNCS.
• To jointly optimize monetary cost and AoI considering control priorities.
• To develop a decision-making framework for timely actuation updates.

Main Methods:

• Formulation of a Markov decision process (MDP) model.
• Derivation of an optimal policy using Q-learning.
• Simulation of the PAUS against existing schemes.

Main Results:

• The proposed PAUS effectively balances monetary cost and AoI.
• Q-learning derived optimal policy maximizes average reward.
• PAUS demonstrates superior performance compared to other schemes in simulations.

Conclusions:

• PAUS provides an effective solution for managing actuation updates in WNCS.
• The scheme successfully integrates priority considerations into cost-AoI trade-offs.
• The Q-learning approach offers an efficient method for policy optimization.