富里埃域中的非同寻常的时间和记忆效率大规模正规相关性分析:从浅到深
IEEE transactions on neural networks and learning systems
|August 1, 2023
概括
对于大型数据集,正规相关性分析 (CCA) 现已成为现实. 一种新的福里埃域方法显著加快了训练速度,减少了内存的使用,比现有技术快1000倍的速度达到可比准确度.
科学领域:
- 机器学习 机器学习
- 统计 统计 统计 统计
- 信号处理 信号处理
背景情况:
- 准则相关性分析 (CCA) 是一种重要的统计技术.
- 传统的CCA面临着大数据集的计算挑战,限制了其实际应用.
- 高复杂性负担处理单元和内存,使大规模的CCA几乎不切实际.
研究的目的:
- 为大规模数据集开发一种新的,高效的CCA方法.
- 克服传统CCA的计算和内存限制.
- 为非线性内核和深度学习模型适应CCA.
主要方法:
- 开发了一种在里埃域中运行的CCA方法.
- 通过元素智能运算将自向量计算转化为学习区分里埃基数.
- 实施了使用部分样本和批处理对自身值的渐进估计方案.
- 将该方法扩展到非线性内核和深度学习模型.
主要成果:
- 拟议的里埃域CCA (FFT-CCA) 证明了非凡的速度和内存效率.
- 实现了与最先进的方法可比的准确性,但训练时间高达1000倍.
- 在大型数据集上进行验证,如MNIST8M,X-RAY MICROBEAM SPEECH和Twitter用户数据.
- 证明了对非线性和深度模型的令人满意的准确性和极快的训练.
结论:
- 法特-CCA方法为大规模的相关性分析提供了显著的进步.
- 这种方法使得CCA成为大数据应用的实用和高效工具.
- 提出的模型代表了处理大规模相关数据集的最佳实践.
更多相关视频
09:01A Method for Investigating Age-related Differences in the Functional Connectivity of Cognitive Control Networks Associated with Dimensional Change Card Sort Performance
Published on: May 7, 2014
10.2K
05:59Author Spotlight: Unlocking New Insights in fNIRS Studies - A Novel Framework for Inter-Brain Synchrony Analysis
Published on: October 6, 2023
2.6K
相关概念视频
Fast Fourier Transform
388
The Fast Fourier Transform (FFT) is a computational algorithm designed to compute the Discrete Fourier Transform (DFT) efficiently. By breaking down the calculations into smaller, manageable sections, the FFT significantly reduces the computational complexity involved. Direct computation of an N-point DFT requires N2 complex multiplications, whereas the FFT algorithm needs only (N/2)log2N multiplications, offering a much faster performance.
The computational efficiency of the FFT becomes...
The computational efficiency of the FFT becomes...
388
Continuous -time Fourier Transform
348
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
348
Calculating and Interpreting the Linear Correlation Coefficient
6.0K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
6.0K
Discrete Fourier Transform
324
The Discrete Fourier Transform (DFT) is a fundamental tool in signal processing, extending the discrete-time Fourier transform by evaluating discrete signals at uniformly spaced frequency intervals. This transformation converts a finite sequence of time-domain samples into frequency components, each representing complex sinusoids ordered by frequency. The DFT translates these sequences into the frequency domain, effectively indicating the magnitude and phase of each frequency component present...
324
Linear Approximation in Frequency Domain
111
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
111
Discrete-time Fourier transform
377
The Discrete-Time Fourier Transform (DTFT) is an essential mathematical tool for analyzing discrete-time signals, converting them from the time domain to the frequency domain. This transformation allows for examining the frequency components of discrete signals, providing insights into their spectral characteristics. In the DTFT, the continuous integral used in the continuous-time Fourier transform is replaced by a summation to accommodate the discrete nature of the signal.
One of the notable...
One of the notable...
377
