一个快速前的小世界神经网络用于非线性系统建模.
概括
一个新的快速前小世界神经网络 (FFSWNN) 通过优先考虑远距离连接来提高学习效率. 这种FFSWNN在非线性系统建模中表现出更快的融合和更高的准确性.
科学领域:
- 人工智能的人工智能
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 向小世界神经网络 (FSWNNs) 使用跨层连接来实现高效的梯度传输,增强学习和概括.
- 在FSWNNs中随机重新布线限制了长距离跨层连接的充分利用,阻碍了最佳性能.
研究的目的:
- 提出一个快速的FSWNN (FFSWNN),最大限度地利用长距离跨层连接的好处,以提高学习效率.
- 将拟议的FFSWNN应用于非线性系统建模.
主要方法:
- 开发了一项新的重新布线规则,优先考虑长途连接,以提高FFSWNN建设期间的梯度传输效率.
- 引入了一种改进的回归方法,用于确定西格神经元的最佳初始重量.
- 为FFSWNN训练设计了一个异步学习算法,它结合了输出层重量和梯度下降的脊回归.
主要成果:
- 与现有模型相比,FFSWNN显示了明显更快的融合速度.
- 拟议的模型在非线性系统建模任务中实现了更高的建模精度.
- 实验证实了新型重新布线规则,改善重量初始化和异步学习对整体效率的积极影响.
结论:
- 拟议的FFSWNN有效地利用长距离跨层连接来提高学习效率和建模准确性.
- 这项研究验证了新型重新布线策略,重量初始化和异步学习算法的有效性.
- FFSWNN为先进的非线性系统建模应用提供了一个有前途的方法.
相关概念视频
Linear Approximation in Frequency Domain
89
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
89
Linear Approximation in Time Domain
81
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
81
Feedback control systems
307
Feedback control systems are categorized in various ways based on their design, analysis, and signal types.
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
307
Linear time-invariant Systems
252
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
252
Classification of Systems-I
180
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
180
State Space Representation
203
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
203


