非线性规范化解码方法用于语音识别
Jiang Zhang1, Liejun Wang1, Yinfeng Yu1
1College of Computer Science and Technology, Xinjiang University, Urumqi 830017, China.
我们开发了一种新的语音识别方法,使用非线性解码和规范化来减少错误. 这种方法提高了准确性,特别是对于小型数据集,并提供了更高效的微型模型.
科学领域:
- 人工智能的人工智能
- 自然语言处理自然语言处理.
- 机器学习 机器学习
背景情况:
- 目前的端到端语音识别依赖于混合CTC和变压器解码器.
- 这些解码器中的错误积累限制了准确性改进.
- 变压器模型通常对小数据集来说过于复杂.
研究的目的:
- 为语音识别引入非线性规范化解码方法.
- 解决现有的基于变压器的语音识别模型的局限性.
- 为了提高准确性和效率,特别是对于小型数据集.
主要方法:
- 实现了一个非线性变压器解码器,允许任意的字符关联,克服左向右的限制.
- 引入了正规化注意力模块,以优化注意力得分和减轻错误传播.
- 开发了一个微小的模型来减少参数大小并提高效率.
主要成果:
- 拟议的模型实现了显著的维吾尔语音识别改进.
- 在Aishell1上,识别精度增加了0.12%,在Primewords上增加了0.54%,在Free ST Chinese Corpus上增加了0.51%,在Common Voice上增加了1.2%.
- 非线性方法在较小的数据集上表现出有效性.
结论:
- 非线性规则化解码方法为传统语音识别解码器提供了一个有希望的替代方案.
- 这种方法有效地减少了错误的积累,并提高了准确性.
- 这种微小的模型变体为资源有限的环境提供了高效的解决方案.
更多相关视频
09:09Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
06:09P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation
Published on: September 8, 2023
相关概念视频
Linear Approximation in Frequency Domain
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
Linear Approximation in Time Domain
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
Residuals and Least-Squares Property
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Reconstruction of Signal using Interpolation
