Related Experiment Video
Updated: Nov 8, 2025

11:18
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
10.5K
Solving infinite-horizon optimalcontrol problems of the time-delayedsystems by a feed forward neural network model
Alireza Nazemi1, Ensieh Fayyazi1
1Department of Mathematics,School of Mathematical Sciences, Shahrood University of Technology,Shahrood, Iran.
Summary
This study introduces a novel neural network method to solve complex time-delayed optimal control problems. The approach transforms the problem and uses neural networks to efficiently find optimal solutions.
Area of Science:
- Control Theory
- Computational Mathematics
- Artificial Intelligence
Background:
- Optimal control problems with time delays are challenging due to their infinite dimensionality.
- Existing numerical methods often struggle with convergence and computational efficiency for such problems.
- The Pontryagin Minimum Principle (PMP) provides necessary conditions for optimality but can be difficult to solve analytically.
Purpose of the Study:
- To develop a robust and efficient numerical method for solving infinite-horizon time-delayed optimal control problems.
- To leverage neural networks for approximating solutions to the Hamiltonian conditions derived from the PMP.
- To demonstrate the effectiveness of the proposed method through various examples.
Main Methods:
- Transformation of the time-delayed optimal control problem into a non-delayed equivalent using Páde approximation.
- Conversion of the non-delayed infinite-horizon problem into a finite-horizon nonlinear optimal control problem via a change of variables.
- Approximation of the PMP's Hamiltonian conditions by defining and minimizing an error function using neural networks.
- Optimization of neural network weights and biases to satisfy all PMP conditions.
Main Results:
- The proposed neural network-based method successfully approximates the optimal solutions for infinite-horizon time-delayed optimal control problems.
- The method effectively handles the complexities introduced by time delays and infinite horizons.
- Numerical examples validate the efficiency and accuracy of the developed technique.
Conclusions:
- The neural network approach offers a powerful tool for solving a class of optimal control problems previously difficult to address numerically.
- This method provides a viable alternative for researchers and engineers dealing with time-delayed control systems.
- Further research can explore extensions of this method to more complex control scenarios.
Related Concept Videos
Feedback control systems
541
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
541
Time-Domain Interpretation of PD Control
220
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
220
Linear Approximation in Time Domain
181
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
181
Linear time-invariant Systems
595
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
595
First Order Systems
236
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
236
State Space Representation
345
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
345
