A novel recurrent neural network for solving nonlinear optimization problems with inequality constraints

Area of Science:

• Computational mathematics
• Artificial intelligence
• Optimization theory

Background:

• Nonlinear optimization problems with inequality constraints are prevalent in various scientific and engineering fields.
• Existing projection neural networks have limitations in solving certain classes of constrained optimization problems.
• The stability and convergence of neural networks for optimization are critical research areas.

Purpose of the Study:

• To introduce a novel recurrent neural network (RNN) designed for solving nonlinear optimization problems with inequality constraints.
• To analyze the stability and convergence properties of the proposed RNN.
• To demonstrate the superiority of the proposed RNN over existing methods for a broader range of optimization problems.

Main Methods:

• Development of a novel recurrent neural network architecture.
• Mathematical analysis of the network's stability using Lyapunov stability theory.
• Demonstration of global convergence to Karush-Kuhn-Tucker (KKT) points under specific conditions (positive semidefinite Hessian of the Lagrangian).
• Comparative simulations against existing projection neural networks.

Main Results:

• The proposed RNN is proven to be stable at KKT points under the specified Hessian condition.
• The network's output trajectory demonstrates global convergence to a minimum solution.
• The RNN effectively solves both constrained convex and a class of constrained nonconvex optimization problems.
• No initial point restriction is required for the proposed network, unlike some existing methods.

Conclusions:

• The novel recurrent neural network offers a robust and effective solution for nonlinear optimization problems with inequality constraints.
• The network's ability to handle both convex and certain nonconvex problems, along with its global convergence properties, marks a significant advancement.
• The proposed method overcomes limitations of existing projection neural networks, showing broad applicability and effectiveness through simulations.