一个联合时间频域变压器用于多变量时间序列预测.
Yushu Chen1, Shengzhuo Liu2, Jinzhe Yang3
1Department of Computer Science and Technology, Tsinghua University, RM.3-126, FIT Building, Haidian District, Beijing, 100084, China.
概括
联合时间频域变压器 (JTFT) 通过结合时间和频域来改善长期多变量预测. 这种新的方法实现了线性计算复杂性,并提高了复杂数据集的预测性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 时间序列分析时间序列分析
背景情况:
- 变压器模型在序列建模方面表现出色,但在长序列的情况下面临计算挑战.
- 多变量预测需要捕捉复杂的时间依赖性和非静止性.
研究的目的:
- 引入一种新的变压器架构,即联合时频域变压器 (JTFT),用于高效的长期多变量预测.
- 为了提高预测性能,同时降低计算需求.
主要方法:
- 为了预测,JTFT集成了时间和频率域表示.
- 频率域捕获使用可学习频率的多尺度依赖关系.
- 时间域使用最近的数据点来建模局部关系和非静止性.
- 一个低级的注意层有效地处理跨维度的依赖关系.
主要成果:
- JTFT实现了线性计算复杂性,独立于输入序列长度.
- 与最先进的基线相比,该模型显示出优越的预测性能.
- 在八个不同的现实世界数据集上进行的实验验证实了JTFT的有效性.
结论:
- 对于长期的多变量预测,JTFT提供了一种高效,高性能的解决方案.
- 联合时间频率方法有效地解决了传统变压器模型的局限性.
相关概念视频
Properties of DTFT I
401
In signal processing, Discrete-Time Fourier Transforms (DTFTs) play a critical role in analyzing discrete-time signals in the frequency domain. Various properties of the DTFTs such as linearity, time-shifting, frequency-shifting, time reversal, conjugation, and time scaling help understand and manipulate these signals for different applications.
The linearity property of DTFTs is fundamental. If two discrete-time signals are multiplied by constants a and b respectively, and then combined to...
The linearity property of DTFTs is fundamental. If two discrete-time signals are multiplied by constants a and b respectively, and then combined to...
401
Discrete-Time Fourier Series
257
The Discrete-Time Fourier Series (DTFS) is a fundamental concept in signal processing, serving as the discrete-time counterpart to the continuous-time Fourier series. It allows for the representation and analysis of discrete-time periodic signals in terms of their frequency components. Unlike its continuous counterpart, which utilizes integrals, the calculation of DTFS expansion coefficients involves summations due to the discrete nature of the signal.
For a discrete-time periodic signal x[n]...
For a discrete-time periodic signal x[n]...
257
Discrete-time Fourier transform
309
The Discrete-Time Fourier Transform (DTFT) is an essential mathematical tool for analyzing discrete-time signals, converting them from the time domain to the frequency domain. This transformation allows for examining the frequency components of discrete signals, providing insights into their spectral characteristics. In the DTFT, the continuous integral used in the continuous-time Fourier transform is replaced by a summation to accommodate the discrete nature of the signal.
One of the notable...
One of the notable...
309
Properties of Fourier Transform II
211
The Fourier Transform (FT) is an essential mathematical tool in signal processing, transforming a time-domain signal into its frequency-domain representation. This transformation elucidates the relationship between time and frequency domains through several properties, each revealing unique aspects of signal behavior.
The Frequency Shifting property of Fourier Transforms highlights that a shift in the frequency domain corresponds to a phase shift in the time domain. Mathematically, if x(t) has...
The Frequency Shifting property of Fourier Transforms highlights that a shift in the frequency domain corresponds to a phase shift in the time domain. Mathematically, if x(t) has...
211
Properties of Fourier Transform I
170
The application of Fourier Transform properties in radio broadcasting is multifaceted, enabling significant advancements in the way signals are transmitted and received. Key areas where these properties are utilized include simultaneous multi-channel transmission, audio clip speed adjustments, live broadcast delays for different time zones, audio frequency adjustments, and signal demodulation.
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...
In radio broadcasting, multiple audio signals often need to be transmitted simultaneously. The Fourier...
170
Continuous -time Fourier Transform
312
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
312


