通过稀疏的关联结构对齐来适应时间序列领域:学习不变性和差异性
Zijian Li1, Ruichu Cai2, Jiawei Chen2
1Guangdong University of Technology, Guangzhou, 510006, Guangdong, China; Mohamed bin Zayed University of Artificial Intelligence, Masdar City, Abu Dhabi, United Arab Emirates.
概括
本研究介绍SASA2,一种用于时间序列域适应的新方法,通过调整稳定的因果结构和增强域特定信息来改进异常检测和预测. 该方法在真实世界的数据集上取得了最先进的结果.
科学领域:
- 机器学习 机器学习
- 时间序列分析 时间序列分析
- 因果推理因果推理
背景情况:
- 对时间序列数据的域调整对于工业应用,如异常检测和预测至关重要,但在学术上未得到充分探索.
- 现有的方法通常依赖于共同变量转移假设,但由于复杂的依赖关系和对时间滞后的敏感性,这些假设在时间序列中经常被违反.
- 跨域的因果结构的稳定性为强大的域适应提供了一个有希望的替代方案.
研究的目的:
- 为时间序列数据开发一种新的无监督域适应方法,利用稳定的关联结构.
- 通过将域特定信息与域不变结构相结合,增强域适应性.
- 提高时间序列域适应模型的性能和可解释性.
主要方法:
- 提出了稀疏关联结构调整模型与特定领域信息增强 (SASA2).
- 生成了部分集以减轻偏移问题,并使用稀疏注意力机制提取了未加权的稀疏关联结构.
- 通过自动回归模块集成域特定信息,并使用单向对齐来实现源到目标转换.
主要成果:
- SASA2实现了最先进的性能,在三个不同的现实数据集 (空气质量,医疗保健,异常检测) 上显示了5%的相对改善.
- 该方法成功地对准了不变的稀疏关联结构,同时利用了变异域特定信息.
- 学习结构的可视化为可转移知识提供了洞察力,提高了模型的透明度和可解释性.
结论:
- 拟议的SASA2模型通过专注于稳定的关联结构,有效地解决了时间序列无监督域调整的挑战.
- 将特定领域的信息与不变结构相结合,可以显著提高性能.
- 该方法在时间序列分析中为域调整提供了更透明和更易于解释的方法.
相关概念视频
Associative Learning
317
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
317
Linear Approximation in Frequency Domain
88
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
88
Linear Approximation in Time Domain
72
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
72
Per-Unit Sequence Models
73
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
73
Linear time-invariant Systems
229
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
229
Variability: Analysis
133
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
133


