MSA-LR:在多变量时间序列预测中增强多尺度时间动态,以低级别的自我注意
Jie Sun1, Zhilin Sun2, Zhongshan Chen3
1School of Information Engineering, Nanjing Xiaozhuang University, 211171, Nanjing, China.
概括
本研究介绍了多尺度自我注意与低级近似 (MSA-LR),这是一种用于多变量时间序列预测的新型深度学习模型. MSA-LR有效地捕捉了多个尺度的时间动态,提高了长期预测的准确性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 时间序列分析时间序列分析
背景情况:
- 深度学习模型在时间序列数据中难以捕捉跨多个尺度的复杂时间依赖性.
- 像LSTM和变压器这样的现有架构在处理远程依赖和区分周期性方面存在局限性.
研究的目的:
- 引入MSA-LR (低级近似的多尺度自我注意),一种用于增强多变量时间序列预测的新型架构.
- 为了有效地捕捉多个尺度的时间动态,并提高长期预测的准确性.
主要方法:
- 开发了MSA-LR,一种新的架构,利用可学习量级权重矩阵和低级近似.
- 设计用于直接模拟不同时间细粒度的影响 (例如,每小时,每天,每周).
- 与标准的自我注意力相比,减少了计算复杂性,以有效处理长时间序列.
主要成果:
- 在各种数据集 (电力负载,交通流量,空气质量) 上,MSA-LR表现出与最先进的方法相比具有竞争力的性能.
- 在长期预测准确度方面取得了显著的改进.
- 在各种分辨率下有效地识别和利用周期性模式.
结论:
- MSA-LR成功地在现实世界时间序列数据中捕获了丰富的多尺度时间结构.
- 该模型提供了对多尺度交互的细粒度控制,并降低了计算成本.
- MSA-LR为准确和高效的多变量时间序列预测提供了一个有希望的进步.
相关概念视频
Time-Series Graph
5.0K
A time-series graph is a line graph with repeated measurements taken at successive intervals of time. It is also called a time series chart. To construct a time-series graph, one must look at both pieces of a paired data set. The horizontal axis is used to plot the time increments, and the vertical axis is used to plot the values of the variable that one is measuring. By using the axes in this way, each point on the graph will correspond to time and a measured quantity. The points on the graph...
5.0K
End Point Prediction: Gran Plot
1.2K
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
1.2K
Sampling Continuous Time Signal
689
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
In the...
689
Linear Approximation in Time Domain
345
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
345
