通过噪声意识提高强大的损失的耐噪能力
IEEE transactions on neural networks and learning systems
|September 27, 2024
概括
这项研究引入了一种新的元学习方法,用于强大的损失最小化,使依赖实例的超参数能够在机器学习模型中增强噪声耐受性. 该方法可自适应地调整参数,改善对杂数据集的概括性.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 计算机科学 计算机科学
背景情况:
- 强大的损失最小化对于处理噪音标签的机器学习模型至关重要.
- 目前的方法依赖于固定的超参数,限制了对单个样本噪声特性的适应性.
- 独立于实例的超参数阻碍了模型识别不同样本对学习的贡献的能力.
研究的目的:
- 开发一个强大的损失最小化策略,使用依赖实例的超参数来提高噪声耐受性.
- 为了应对各种噪音数据集找到合适的超参数的挑战.
- 增强模型区分单个噪声特性的能力,并利用多样化的样本贡献.
主要方法:
- 提出了一种超学习方法,以适应性学习超参数预测函数 (NARL-Adjuster).
- 集成了NARL-调节器与四个最先进的强大的损失功能.
- 采用超参数预测函数和分类器参数之间的相互改善,以实现同时优化.
主要成果:
- 通过全面的实验证明了卓越的噪声耐受性和性能.
- 在各种数据集中验证了拟议方法的一般可用性和有效性.
- 与传统的超参数调整相比,在未见的噪音数据集上实现了更好的性能.
结论:
- 提出的依赖实例的超参数方法显著改善了强大的损失最小化.
- 经过meta学习的NARL-Adjuster可转移,可用于未见的噪音数据集.
- 这种方法为处理机器学习中的噪音标签提供了更有效和更适应的解决方案.
相关概念视频
Reducing Line Loss
149
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
149
Propagation of Uncertainty from Random Error
655
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
655
Propagation of Uncertainty from Systematic Error
489
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
489
Lossy Lines and Overvoltages
87
Transmission-line series resistance and shunt conductance cause three primary effects: attenuation, distortion, and power losses.
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
87
Difference from Background: Limit of Detection
5.9K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.9K
Perceiving Loudness, Pitch, and Location
198
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
198


