对于秘鲁手语的时间视频分割方法
Summy Farfan1, Juan J Choquehuanca-Zevallos1,2, Ana Aguilera3,4
1Electrical and Electronics Engineering Department, Universidad Católica San Pablo, Arequipa 04001, Peru.
Sensors (Basel, Switzerland)
|September 13, 2025
概括
这项研究通过改善时间细分来增强持续的手语识别. 一个基于扩散的模型在识别秘鲁手语视频中的个体标志和转换方面表现出了卓越的表现.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 语言学的语言学.
背景情况:
- 持续的手语识别 (CSLR) 涉及翻译完整的手语视频序列.
- 时间视频细分对于在CSLR中区分标志与过渡至关重要.
- 当前的CSLR方法经常使用过时的架构,限制了进步.
研究的目的:
- 确定区分符号与连续手语转换的关键特征.
- 适应和评估手语的现代时间细分模型.
- 提高手语识别系统的准确性和稳定性.
主要方法:
- 调整了两个时间细分模型:diffAct (基于扩散) 和MS-TCN.
- 将模型应用于精确注释的秘鲁手语数据集.
- 探索了三个培训策略:基线,数据增强和多数据集.
主要成果:
- 训练策略改善了两种模型的得分,但增加了变化.
- 基于扩散的模型 (DiffAct) 对未见的序列表现出更好的概括性.
- DiffAct在标志和过渡识别方面取得了很高的分数 (中位数mF1S: 71.89%,mF1B: 72.68%).
结论:
- 现代的时间细分模型可以有效地应用于手语识别.
- 基于扩散的方法显示出强大的CSLR的前景.
- 进一步的研究可以完善这些方法,以改善手语理解.
相关概念视频
01:14Extraction: Partition and Distribution Coefficients
The distribution law or Nernst's distribution law is the law that governs the distribution of a solute between two immiscible solvents. This law, also known as the partition law, states that if a solute is added to the mixture of two immiscible solvents at a constant temperature, the solute is distributed between the two solvents in such a way that the ratio of solute concentrations in the solvents remains constant at equilibrium.
For extracting a solute from an aqueous phase into an organic...
For extracting a solute from an aqueous phase into an organic...
01:20Deconvolution
Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
01:15Sampling Theorem
In signal processing, the analysis of continuous-time signals, denoted as x(t), often involves sampling techniques to convert these signals into discrete-time signals. This process is essential for digital representation and manipulation. A critical component in sampling is the train of impulses, characterized by the sampling interval and the sampling frequency. The relationship between these parameters and the original signal's properties dictates the success of the sampling process.
01:20Downsampling
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
01:28Synthetic Disvision of Polynomials
Synthetic division is an efficient algorithmic approach for dividing a polynomial by a linear binomial of the form x - c, where c is a real number. This method is helpful due to its streamlined process, which avoids the more cumbersome steps involved in the traditional long division of polynomials. It simplifies computation and serves as a practical tool for evaluating polynomials and identifying their factors.To perform synthetic division, one begins by listing the coefficients of the...