神经网络如何学会分类混乱的时间序列
Alessandro Corbetta1, Thomas Geert de Jong2
1Department of Applied Physics, Eindhoven University of Technology, 5600 MB Eindhoven, The Netherlands.
Chaos (Woodbury, N.Y.)
|December 4, 2023
概括
大核卷积神经网络 (LKCNNs) 有效地对混乱的时间序列进行分类. 性能差的模型会定期激活,为在部署前识别不准确的网络权重提供标准.
科学领域:
- 动态系统 动态系统
- 机器学习 机器学习
- 时间序列分析时间序列分析
背景情况:
- 分析神经网络的时间序列分类至关重要.
- 大内核卷积神经网络 (LKCNNs) 在正规与混乱时间序列分类中表现出卓越的性能.
- LKCNNs的表现优于传统的方法,如利亚普诺夫指数计算.
研究的目的:
- 分析用于时间序列分类的LKCNNs的内部机制.
- 了解为什么一些LKCNNs达到高精度,而另一些则表现不佳.
- 确定预测受过训练的LKCNNs表现不佳的标准.
主要方法:
- 调查的LKCNN在正规和混乱的时间序列数据上进行了训练.
- 分析网络激活以了解分类策略.
- 用随机权重初始化模型的性能比较.
主要成果:
- LKCNN利用输入序列的定性特征进行分类.
- 经过训练的LKCNN模型分为两个不同的性能组:高 (0.94准确度) 和低 (0.72准确度).
- 低性能模型显示定期激活,类似于随机初始化的网络.
结论:
- 在LKCNNs中的定期激活与低分类准确性相关.
- 这些激活模式为预先识别表现不佳的训练重量提供了潜在的方法.
- 了解LKCNN内部动态可以提高时间序列分析中的模型可靠性.
相关概念视频
Classification of Signals
472
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
472
Classification of Systems-II
149
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
149
Classification of Systems-I
188
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
188
Linear time-invariant Systems
262
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
262
First Order Systems
93
First-order systems, such as RC circuits, are foundational in understanding dynamic systems due to their straightforward input-output relationship. Analyzing their responses to different input functions under zero initial conditions reveals significant insights into system behavior.
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
When a first-order system is subjected to a unit-step input, its response is characterized by its transfer function. By applying the Laplace transform of the unit-step input to the transfer function, expanding the...
93
State Space Representation
210
The frequency-domain technique, commonly used in analyzing and designing feedback control systems, is effective for linear, time-invariant systems. However, it falls short when dealing with nonlinear, time-varying, and multiple-input multiple-output systems. The time-domain or state-space approach addresses these limitations by utilizing state variables to construct simultaneous, first-order differential equations, known as state equations, for an nth-order system.
Consider an RLC circuit, a...
Consider an RLC circuit, a...
210


