Reservoir computing meeting Kolmogorov-Arnold networks: Prediction of high-dimensional chaotic systems
Gen Li1, Liang Huang1, Youming Lei1,2
1School of Mathematics and Statistics, Northwestern Polytechnical University, Xi'an 710072, China.
Abstract:
The prediction of high-dimensional chaotic time series is a widely concerned and highly challenging task. We propose a novel method, reservoir computing Kolmogorov-Arnold networks, that combines reservoir computing and Kolmogorov-Arnold networks to address this difficult issue. The proposed method involves replacing the linear output layer of traditional reservoir computing with Kolmogorov-Arnold networks and employs a training scheme that incorporates the teacher-forcing mode and the free-running mode during the training process, respectively. We utilize the multiscale Lorenz-96 system and the Kuramoto-Sivashinsky equation as two examples of high-dimensional chaotic systems to illustrate the feasibility of our method. The results of comparative experiments demonstrate that our method exhibits superior prediction capabilities and maintains robustness in the presence of noise perturbation and hyperparameter variations.
Related Concept Videos
Random Variables
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
Linear time-invariant Systems
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
Multi-input and Multi-variable systems
In the absence of...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
