计算与MFCC和卷积神经网络相匹配
Andrés Lozano1, Enrique Nava1, María Dolores García Méndez2
1Department of Communication Engineering, University of Málaga, Málaga, Spain.
PloS one
|December 31, 2024
概括
使用卷积神经网络 (CNN) 与Mel-Frequency Cepstrum系数 (mfccNasalance) 的新方法提供了一种比传统方法更准确的方法来测量鼻. 这种方法在评估超鼻性时显示出临床应用的前景.
科学领域:
- 语音声学和信号处理
- 计算机语言学和语音学
- 生物医学工程和临床生物标志物
背景情况:
- 鼻腔测量对于诊断高鼻度至关重要.
- 传统的eNasalance计算有其局限性.
- 开发先进的计算方法可以提高生物标志物的准确性.
研究的目的:
- 引入和评估使用卷积神经网络 (CNN) 和Mel-Frequency Cepstrum系数 (mfccNasalance) 的鼻计算的新方法.
- 评估mfccNasalance在不同方言和语音动态的准确性.
- 为了比较mfccNasalance与传统eNasalance的性能.
主要方法:
- 利用不同方言 (哥斯达黎加,西班牙,智利) 的健康发言者的双通道鼻子仪语音数据.
- 训练有素的CNN模型使用来自250ms移动窗口的39个MFCC向量的序列.
- 使用斯皮尔曼相关性对各种测试数据 (简短的单词,句子,二度动力学音节) 的专家感知鼻性得分进行准确性评估.
主要成果:
- 在相同方言条件下,mfccNasalance表现出比eNasalance更高的准确性,无论CNN的配置如何.
- 一个1x1内核提高了动态发言的准确性,而内核形状显著影响了非动态发言.
- 在不同的方言条件下,表现下降,特别是对于在哥斯达黎加数据上训练的模型.
结论:
- mfccNasalance提供了一种灵活和有效的替代eNasalance用于测量鼻腔平衡.
- 对于CNN模型的选择,应考虑语音数据的动态性,以获得最佳的mfccNasalance性能.
- 需要进一步的研究来完善CNN模型优化对各种语言条件的优化.
更多相关视频
相关概念视频
Fast Fourier Transform
197
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
197
Convolution: Math, Graphics, and Discrete Signals
195
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
195
Linear Approximation in Frequency Domain
79
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
79
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
25
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
25
Association Areas of the Cortex
4.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
4.4K
Convolution Properties II
143
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
143


