Related Experiment Videos
Prediction of noisy chaotic time series using an optimal radial basis function neural network
1Department of Electrical and Computer Engineering, University of Calgary, Calgary, AB T2N 1N4, Canada.
IEEE Transactions on Neural Networks
|February 6, 2008
Summary
Predicting noisy chaotic time series with radial basis function (RBF) networks requires a finite number of hidden units. A new cross-validated subspace method effectively determines the optimal number of hidden units for accurate prediction.
Area of Science:
- * Computational neuroscience
- * Time series analysis
- * Machine learning
Background:
- * Predicting chaotic time series is challenging, especially with noise.
- * Radial basis function (RBF) networks are used for nonlinear function approximation.
- * In noiseless conditions, RBF predictors require infinite hidden units for optimal generalization.
Purpose of the Study:
- * To develop an optimal prediction method for noisy chaotic time series using RBF networks.
- * To propose a novel technique for determining the optimal number of hidden units in RBF predictors.
- * To address the issue of overfitting in noisy data prediction.
Main Methods:
- * Application of radial basis function (RBF) networks for time series prediction.
- * Development of the cross-validated subspace method to estimate the optimum number of hidden units.
- * Utilizing subspace techniques to identify signal subspace dimension via eigenvectors.
- * Employing cross-validation to mitigate overfitting.
Main Results:
- * Demonstrated that optimal RBF predictors for noisy data require a finite number of hidden units.
- * Validated the effectiveness of the cross-validated subspace method on simulated and real-world data.
- * Showcased the method's ability to identify the correct number of hidden units for optimal prediction.
Conclusions:
- * The cross-validated subspace method is effective for determining RBF network structure in noisy chaotic time series prediction.
- * This approach balances model complexity and predictive accuracy, preventing overfitting.
- * The findings advance the field of chaotic time series analysis and RBF network optimization.
Related Concept Videos
Linear Approximation in Time Domain
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
Linear Approximation in Frequency Domain
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear.
Linear time-invariant Systems
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be calculated...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be calculated...