最小确定性回声状态网络在学习混乱动态方面表现优于随机储备
F Martinuzzi1,2
1Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI), Leipzig University, Leipzig, Germany.
Chaos (Woodbury, N.Y.)
|September 5, 2025
概括
具有决定性设计的最小复杂度回声状态网络 (MESN) 显著改善混乱系统建模,与标准 ESN 相比减少了高达 41% 的错误. 这些MESN为混乱动态提供了增强的稳定性和超参数可重复使用性.
科学领域:
- 计算物理
- 非线性动力学
- 机器学习
背景情况:
- 机器学习 (ML) 是模拟复杂系统,包括混乱动态的强大工具.
- 反响状态网络 (ESN) 是一种经常性神经网络,以时间序列预测的高效训练而闻名.
- 由于随机初始化和超参数调整,标准ESN通常会受到性能敏感性的影响.
研究的目的:
- 研究最小复杂度回声状态网络 (MESN) 对于混乱系统建模的有效性.
- 在混乱吸引器重建中比较MESN与标准ESN的性能.
- 在各种混乱系统中评估MESN的稳定性和超参数可重复使用性.
主要方法:
- 使用简单规则和确定性网络拓的最小复杂度ESN (MESN) 的开发.
- 在超过90个混乱系统的数据集上对MESN进行了10个不同的确定性储备初始化.
- 在MESN和标准ESN之间进行误差指标和运行间变化的定量比较.
主要成果:
- 与标准ESN相比,MESN可以减少41%的重建错误.
- MESN表现出卓越的稳定性,独立运行之间的变化明显较小.
- 确定了MESN在不同混乱系统中有效地重用超参数的能力.
结论:
- 在ESN设计中的结构化简单性 (MESNs) 优于随机复杂性来学习混乱动态.
- MESN为混乱系统建模提供了更可靠和更有效的方法.
- 这些发现突显了确定性网络结构在推进复杂动态的机器学习方面的潜力.
相关概念视频
Transient and Steady-state Response
273
In control systems, test signals are essential for evaluating performance under various conditions. The ramp function is effective for systems undergoing gradual changes, while the step function is suitable for assessing systems facing sudden disturbances. For systems subjected to shock inputs, the impulse function is the most appropriate test signal.
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
273
Classification of Systems-II
240
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
240
First Order Systems
162
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
162
Entropy Change in Reversible Processes
2.7K
In the Carnot engine, which achieves the maximum efficiency between two reservoirs of fixed temperatures, the total change in entropy is zero. The observation can be generalized by considering any reversible cyclic process consisting of many Carnot cycles. Thus, it can be stated that the total entropy change of any ideal reversible cycle is zero.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
2.7K
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model
126
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
126
State Space Representation
281
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
281


