通过状态反来提高回声状态网络的性能.
Peter J Ehlers1, Hendra I Nurdin2, Daniel Soh1
1Wyant College of Optical Sciences, University of Arizona, Tuscon, AZ, USA.
概括
将反添加到回声状态网络 (ESN) 显著提高了顺序数据处理中的性能. 这种水库计算技术可以提高30-60%的准确性,而计算成本最小.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 储计算为处理顺序数据,时间序列建模和系统识别提供了一种具有成本效益的方法.
- 反响状态网络 (ESN) 是一种储库计算,通过使用固定的随机转换和非线性动态来简化神经网络训练.
- 标准ESN的一个局限性是固定的储备库,它可能缺乏对某些具有挑战性的问题的复杂性.
研究的目的:
- 研究将反纳入ESN的影响,以提高其复杂性和性能.
- 为了证明,将水库状态组件作为输入回可以提高ESN的能力.
- 为ESN中反的有效性提供严格的证据和经验证据.
主要方法:
- 实现了反机制,将部分储库状态重定向回网络的输入.
- 利用三个不同的任务代表不同的问题类来评估性能.
- 使用严格的数学证明来证明反的一般适用性.
主要成果:
- 反显著提高了ESN在各种任务中的表现.
- 随着反的增加,平均错误指标减少了30%-60%.
- 反实现了与加倍计算节点数量相比的性能,这是一个更复杂和更昂贵的替代方案.
结论:
- 反是提高ESN性能的广泛适用和非常有用的方案.
- 这种对水库状态的间接修改提供了一种计算效率高的方法来增加系统复杂性.
- 这些发现表明,反作为改进储计算应用程序的强大工具.
相关概念视频
Effects of feedback
514
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
514
State Space Representation
162
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
162
Feedback control systems
281
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
281
Control Systems
1.0K
Control systems are everywhere in contemporary society, influencing diverse applications from aerospace to automated manufacturing. These systems can be found naturally within biological processes, such as blood sugar regulation and heart rate adjustment in response to stress, as well as in man-made systems like elevators and automated vehicles. A control system is essentially a network of subsystems and processes that collaboratively convert specific inputs into desired outputs.
At the heart...
At the heart...
1.0K
Transient and Steady-state Response
143
In control systems, test signals are essential for evaluating performance under various conditions. The ramp function is effective for systems undergoing gradual changes, while the step function is suitable for assessing systems facing sudden disturbances. For systems subjected to shock inputs, the impulse function is the most appropriate test signal.
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
These test signals are integral in designing control systems to exhibit two key performance aspects: transient response and steady-state...
143
Transfer Function to State Space
192
State-space representation is a powerful tool for simulating physical systems on digital computers, necessitating the conversion of the transfer function into state-space form. Consider an nth-order linear differential equation with constant coefficients, like those encountered in an RLC circuit. The state variables are selected as the output and its n−1 derivatives. Differentiating these variables and substituting them back into the original equation produces the state equations.
In an...
In an...
192


