学习时间特征与交替相似性和近距离注意力时间序列预测
IEEE transactions on neural networks and learning systems
|April 30, 2025
概括
我们介绍了交替相似性和近距离注意力 (ASAP注意力),这是一种用于长期时间序列预测的新方法. 通过更好地捕捉复杂的数据依赖性,以获得更准确的预测,ASAP注意力改进了标准的注意力机制.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 时间序列预测在许多科学领域都至关重要.
- 基于注意力的模型对长期预测有希望.
- 香草的注意力在捕捉复杂的依赖性方面有局限性.
研究的目的:
- 为增强时间序列预测提出一种新的注意力机制.
- 为了解决香草注意力在捕捉高阶依赖性的局限性.
- 为了提高长期时间序列预测的准确性.
主要方法:
- 引入了交替相似性和近距离注意力 (ASAP注意力).
- ASAP-attention在两个图表上使用随机步行:一个是特征相似性,另一个是时间接近性.
- 该模型交替访问这些图表,利用先前的状态进行连贯的预测.
- 集成的ASAP注意力,只有编码器的变压器架构.
主要成果:
- 与最先进的方法相比,ASAP注意力表现出更高的性能.
- 在用于长时间序列预测的各种基准数据集上取得了非常有前途的结果.
- 该方法有效地捕获隐性和异质数据依赖,而不需要位置编码.
结论:
- ASAP-attention为长期时间序列预测提供了一种强大的新方法.
- 拟议的方法增强了模拟复杂的时间和特征相互作用的能力.
- ASAP-attention显示出在天气,金融和医疗预测方面的应用潜力很大.
相关概念视频
Time-Series Graph
4.2K
A time-series graph is a line graph with repeated measurements taken at successive intervals of time. It is also called a time series chart. To construct a time-series graph, one must look at both pieces of a paired data set. The horizontal axis is used to plot the time increments, and the vertical axis is used to plot the values of the variable that one is measuring. By using the axes in this way, each point on the graph will correspond to time and a measured quantity. The points on the graph...
4.2K
Prediction Intervals
2.2K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
2.2K
Properties of Laplace Transform-II
153
Time differentiation, convolution, integration, and periodicity are fundamental concepts in analyzing functions and signals over time. Each concept provides a unique perspective on how functions evolve, interact, and repeat, offering essential tools for various scientific and engineering applications.
Time differentiation involves analyzing the rate of change of a function over time. Mathematically, it is the derivative of a function with respect to time. This concept can be likened to tracking...
Time differentiation involves analyzing the rate of change of a function over time. Mathematically, it is the derivative of a function with respect to time. This concept can be likened to tracking...
153
Linear time-invariant Systems
177
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
177
Linear Approximation in Frequency Domain
79
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
79
Associative Learning
236
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
236


