在噪音存在的情况下校准尺寸减小超参数
1Department of Mathematics, Indiana University, Bloomington, Indiana, United States of America.
PLoS computational biology
|September 12, 2024
概括
像t-SNE和UMAP这样的尺寸缩小方法可能会超出噪音数据. 本研究引入了一个校准超参数的框架,防止过拟合,并改善在高维数据分析中的信号检测.
科学领域:
- 数据科学数据科学数据科学
- 机器学习 机器学习
- 计算统计学 计算统计学
背景情况:
- 维度减小技术可以创建低维数据表示,用于可视化,降低噪音和提高效率.
- 在建模中常见的问题是过度装配,但在维度缩小中经常被忽视,与其他建模环境不同.
- 像t-SNE和UMAP这样的流行的非线性方法通常旨在捕获所有数据,忽视信号噪声区分.
研究的目的:
- 突出噪声在高参数校准中发挥的关键作用,以减少尺寸.
- 引入一个新的框架,让用户在考虑噪声的同时校准超参数.
- 调查超参数选择对t-SNE和UMAP超拟合的影响.
主要方法:
- 开发和应用一个框架来评估尺寸减小性能,考虑信号和噪声.
- 分析超参数校准对t-SNE和UMAP超拟合的影响.
- 评估之前推的超参数值 (困难度,n_neighbors) 它们的倾向过度安装噪声.
主要成果:
- 证明了对t-SNE和UMAP的通常推的超参数值可以通过捕获噪声导致过拟合.
- 展示了特定的超参数设置 (例如,较小的困惑和n_neighbors) 会加剧噪音过度拟合.
- 验证了拟议框架在指导超参数选择方面的有效性.
结论:
- 识别噪声对于有效的超参数校准在尺寸缩小方面至关重要.
- 现有的t-SNE和UMAP的默认或推设置可能由于噪音过度调整而不是最佳的.
- 提出的框架提供了一个实用的工作流程,用于在高维数据分析中进行强大的超参数调整.
相关概念视频
01:20Downsampling
137
When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
137
01:22Upsampling
215
Managing signal sampling rates is essential in digital signal processing to maintain signal integrity. A decimated signal, characterized by a reduced frequency range due to its lower sampling rate, can be upsampled by inserting zeros between each sample. This upsampling process expands the original spectrum and introduces repeated spectral replicas at intervals dictated by the new Nyquist frequency. To refine this zero-inserted sequence, it is passed through a lowpass filter with a cutoff...
215
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
45
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
45
01:19Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K