噪音标签学习具有可证明的一致性,用于更广泛的损失家族
概括
本研究引入了动态标签学习 (DLL),以改进使用噪音标签训练的深度学习模型. DLL 确保标签噪声不会阻止为清洁数据找到最佳分类器.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 深度模型在视觉识别方面表现出色,但由于杂的标签,在概括方面扎.
- 当前的深度学习包在选择适合噪音标签场景的损失函数时缺乏透明度.
研究的目的:
- 开发一种方法,有效地利用不同的损失函数在分类任务与标签噪声.
- 确保标签噪声不会阻碍对无噪声样品的最佳分类器的识别.
主要方法:
- 引入一个专门用于噪音标签学习的动态标签学习 (DLL) 算法.
- 理论分析以验证算法的正确性并证明其稳定性.
- 在合成和现实世界数据集上的实验验证.
主要成果:
- 拟议的DLL算法允许使用任何替代损失函数来将其归类为标签噪声.
- 理论分析证实了算法的正确性和对标签噪声的稳定性.
- 实验结果显示了算法的效率,超越或匹配最先进的方法.
结论:
- 动态标签学习 (DLL) 为训练带有噪音标签的深度模型提供了强大的解决方案.
- 该算法确保标签噪声不会影响寻找最佳分类器的搜索.
- 在现实世界杂的场景中,DLL显著提高了深度学习模型的性能和通用性.
相关概念视频
Lossy Lines and Overvoltages
108
Transmission-line series resistance and shunt conductance cause three primary effects: attenuation, distortion, and power losses.
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
Attenuation
When constant series resistance and shunt conductance are present, voltage and current equations are modified. The propagation constant indicates that voltage and current waves consist of both forward and backward traveling components. These waves attenuate as they propagate, with the attenuation factor related to the resistance and conductance. In a...
108
Associative Learning
450
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
450
Reducing Line Loss
174
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
174
Residuals and Least-Squares Property
7.4K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.4K
Propagation of Uncertainty from Random Error
731
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
731
Propagation of Uncertainty from Systematic Error
557
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
557


