格兰杰-TSllm:格兰杰因果关系增强的LLM与多变量时间序列预测的剩余量子化标记器.
Jiaqi Chu1, Chengbao Liu2, Xiwei Bai2
1Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China.
概括
本研究介绍了Granger-TSllm,这是一个使用大型语言模型 (LLM) 来进行多变量时间序列 (MTS) 预测的新框架. 它克服了数据限制,并改善了准确的MTS预测的概括性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 多变量时间序列 (MTS) 预测对于过程监测和决策至关重要.
- 目前的深度学习模型由于培训要求而难以进行概括.
- 大型语言模型 (LLM) 对MTS预测有希望,但面临着模式差距和依赖性挑战.
研究的目的:
- 提出一个新的两阶段框架,Granger-TSllm,用于使用LLMs增强MTS预测.
- 为LLMs生成MTS表示和捕获变量间依赖关系的挑战.
- 提高LLMs在MTS预测任务中的概括能力.
主要方法:
- 开发了一个剩余量化时间序列令牌器,用于紧,离散的MTS嵌入.
- 利用LLMs的选择性微调来进行复杂的时间建模.
- 引入了格兰杰因果关系修改模块,以利用变量间的非线性相关性.
主要成果:
- 格兰杰-TSllm显著超过现有的最先进的MTS预测模型.
- 该框架展示了强大的概括能力.
- 在一些射击和零射击预测场景中取得了卓越的性能.
结论:
- 格兰杰-TSllm为MTS预测提供了一种强大而可通用的方法.
- 法学士与专业模块的整合提高了预测准确度.
- 这种方法有效地弥合了LLM时间序列数据的模式差距.
相关概念视频
Prediction Intervals
3.1K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.1K
Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
Improving Translational Accuracy
3.5K
3.5K
Random Variables
17.2K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
17.2K
End Point Prediction: Gran Plot
1.1K
A Gran plot is used to predict the equivalence volume or endpoint of a potentiometric or acid-base titration without reaching the endpoint. Typically, titration data is collected as a function of the titrant's volume up to a point less than the equivalence volume and then transformed into a linear format. The straight line is extended to the x-axis, indicating the necessary titrant volume to achieve the equivalence point.
For potentiometric titration, the Gran plot is created by plotting...
For potentiometric titration, the Gran plot is created by plotting...
1.1K
Per-Unit Sequence Models
404
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
404
