A novel distributed gradient algorithm for composite constrained optimization over directed network
Minghui Ou1,2, Hao Zhang3,4, Zhenjie Yan5
1School of Big Data and Internet of Things, Chongqing Vocational Institute of Engineering, Chongqing, 402260, PR China. omhcumt_1992@163.com.
Abstract:
This study centers on a specific category of constrained convex optimization. The problems under consideration feature an objective function that is explicitly constructed from the combination of multiple differentiable convex functions and one or more non-smooth regularization components, particularly the [Formula: see text] norm.These problems are further subject to local linear and bound constraints. Such formulations commonly arise in practical domains, including power allocation, sensor network coordination, and source localization. To address these challenges efficiently and robustly, a new distributed optimization approach is developed that utilizes a time-varying yet constant step-size mechanism. Distinctively, by relying solely on row-stochastic weight matrices, the proposed method effectively manages constrained optimization tasks over directed communication networks without necessitating knowledge of each node's out-neighbor information. As long as each local objective satisfies the requirements for convexity and Lipschitz continuity and the chosen time-varying constant step size stays within a predefined upper constraint, theoretical analysis verifies that the suggested method converges to the optimal point. Simulation experiments further validate and reinforce the remarkable efficiency and real-world applicability of the developed method.
Related Concept Videos
Gradient and Del Operator
Implicit Differentiation: Problem Solving
What is an Electrochemical Gradient?
The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an...
Fast Decoupled and DC Powerflow
Distributed Loads: Problem Solving
Vector Algebra: Graphical Method
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...


