Related Experiment Videos
Approximation of nonlinear systems with radial basis function neural networks
R J Schilling1, J J Carroll, A F Al-Ajlouni
1Department of Electrical and Computer Engineering, Clarkson University, Potsdam, NY 13699-5720, USA.
IEEE Transactions on Neural Networks
|February 5, 2008
Summary
This study introduces a novel radial basis function (RBF) neural network technique for function approximation. The method enhances computational efficiency and reduces storage, proving effective for dynamic systems.
Area of Science:
- Computational mathematics
- Artificial intelligence
- Neural networks
Background:
- Function approximation is crucial in many scientific and engineering fields.
- Existing methods may face challenges with computational efficiency and storage requirements.
- Radial Basis Function (RBF) networks offer a powerful framework for approximation tasks.
Purpose of the Study:
- To present an efficient technique for approximating continuous functions using radial basis function (RBF) neural networks.
- To develop an RBF network with a smooth, compact support function for improved performance.
- To reduce computational time and storage space for function approximation.
Main Methods:
- Utilized an n-dimensional raised-cosine type of RBF with compact support.
- Developed a computational procedure to lower network training and evaluation times.
- Employed a nonuniform grid for RBF centers to minimize storage requirements.
Main Results:
- The RBF network coefficients are low-order polynomial functions of the input.
- Network output demonstrated continuity and a continuous first derivative.
- Approximation of nonlinear dynamic systems resulted in bounded-input bounded-output stability.
- Exact and optimal representation was achieved for linear systems.
Conclusions:
- The presented RBF neural network technique offers significant improvements in computational efficiency and storage.
- The method is effective for approximating continuous functions and dynamic systems.
- This approach provides an exact and optimal solution for linear system representation.
Related Concept Videos
Linear Approximation in Frequency Domain
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
Linearization and Approximation
Linearization is a mathematical technique used to approximate complex, nonlinear functions with simpler linear models in the vicinity of a chosen reference point. The method is based on the idea that, although a function may be difficult to evaluate exactly, its behavior near a specific input value can often be closely approximated by the tangent line at that point. This approach is particularly useful when small deviations from a known value are involved.Consider the square root function, for...
Linear Approximation in Time Domain
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
Linear Approximations
For a differentiable function of two variables, linear approximation estimates values near a known point by replacing the curved surface with its tangent plane. Consider the function\begin{equation*}f(x,y)=x^2+3y^2\end{equation*}near the point (2, 1). The exact value at this point is f(2, 1) = 22 + 3(1)2 = 4 + 3 = 7.The linear approximation of f(x, y)) near (a, b) is\begin{equation*}L(x,y)=f(a,b)+f_x(a,b)(x-a)+f_y(a,b)(y-b)\end{equation*}First, compute the partial derivatives: fx(x, y) = 2x and...
Application of Linearization and Approximation
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
Newton’s Method
Newton’s Method is a powerful iterative technique for approximating the roots of real-valued, differentiable functions, particularly when analytical solutions are impractical. This approach is widely used in scientific computing, engineering, and finance, where equations may be too complex for traditional algebraic methods to handle. The method relies on an iterative process that refines an initial estimate using the function’s derivative to approach the true solution progressively.