在对比式学习中,使用可学习的掩盖增强框架来改进时间序列表示特征
Junyeop Lee1, Insung Ham1, Yongmin Kim1
1School of Electrical Engineering, Korea University, Seoul 02841, Republic of Korea.
Sensors (Basel, Switzerland)
|January 8, 2025
概括
这项研究引入了一个新的时间序列表示学习框架,使用可学习的掩盖和对比学习. 这种方法提高了模型捕捉时间模式的能力,从而提高了下游任务的准确性.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 时间序列数据在表示学习中存在挑战,原因是时间依赖性和复杂的特征提取.
- 现有的方法往往难以有效地捕捉全球和本地模式.
研究的目的:
- 为时间序列表示学习提出一个新的框架.
- 通过自主监督学习来增强对时间特征的学习.
- 为了提高学习到的表示的强度和上下文意识.
主要方法:
- 开发了一个新的框架,将可学习的掩盖增强策略集成到对比学习中.
- 在自我监督的学习环境中采用基于掩盖的重建方法.
- 利用可学习的掩饰作为一个动态增强技术来优化上下文关系.
主要成果:
- 与基线方法相比,获得了2% (SleepEDF-78),2.55% (SleepEDF-20) 和3.89% (UCI-HAR) 的精度的性能改善.
- 在包括在内的多个时间序列数据集上显示了显著的性能增长.
- 强调了框架能够捕捉微妙的时间依赖性并改善下游任务性能的能力.
结论:
- 拟议的框架有效地学习了强大且具有上下文意识的时间序列表示.
- 在对比性学习中,可学习的掩盖是推动时间序列分析的有希望的策略.
- 该方法比现有方法提供了显著的改进,为增强时间序列理解铺平了道路.
相关概念视频
Generalization, Discrimination, and Extinction
428
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
428
Associative Learning
287
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
287
Per-Unit Sequence Models
71
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
71
Difference from Background: Limit of Detection
5.8K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.8K
Linear Approximation in Time Domain
62
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
62
Improving Translational Accuracy
8.7K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.7K


