BPT-PLR:一个平衡的分区和培训框架与伪标签放松的对比损失噪音标签学习
Qian Zhang1, Ge Jin1,2, Yi Zhu1
1School of Information Technology, Jiangsu Open University, Nanjing 210036, China.
Entropy (Basel, Switzerland)
|July 26, 2024
概括
这项研究引入了一个新的框架,BPT-PLR,以改善噪音标签的数据集上的深度神经网络性能. 它解决了阶级不平衡和优化冲突,在杂的标签学习中取得最佳结果.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 训练数据中的噪音标签难以和昂贵地消除,导致深度神经网络 (DNN) 过度匹配和糟糕的泛化.
- 噪音标签学习 (NLL) 是至关重要的,因为DNN最初学习干净的样本,然后再过调到噪音样本.
- 现有的NLL方法与数据子集中的类不平衡以及对比和监督学习之间的优化冲突作斗争.
研究的目的:
- 提出一个新的框架,平衡分区和训练与伪标签放松的对比损失 (BPT-PLR),以有效地处理DNN中的噪音标签.
- 为了解决当前NLL方法中固有的类失衡和优化冲突.
- 提高DNN分类性能和对有噪音标签的数据集的概括性.
主要方法:
- 使用2D高斯混合模型 (BP-GMM) 的平衡分区过程,以基于语义特征和预测识别噪音标签,同时保持类平衡.
- 一个半监督的过量采样培训过程,使用伪标签放松对比损失 (SSO-PLR) 来缓解优化冲突.
- 利用语义特征信息和模型预测结果,实现强大的噪音标签识别.
主要成果:
- 在基准NLL数据集:CIFAR-10/100,动物-10N和服装1M上,BPT-PLR证明了它的有效性.
- 与最先进的NLL技术相比,提出的方法实现了最佳或接近最佳的性能.
- BP-GMM成功地识别了噪音标签,同时在子集中保持了类平衡.
- SSO-PLR有效地减少了优化冲突,提高了整体模型性能.
结论:
- 通过有效分区数据和优化培训,BPT-PLR为噪音标签学习提供了强大的解决方案.
- 该框架成功地克服了现有方法的局限性,特别是类不平衡和优化冲突.
- 在有噪音标签的情况下,BPT-PLR显著提高了DNN泛化和分类性能.
更多相关视频
05:48Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
1.5K
07:12Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
320
相关概念视频
Residuals and Least-Squares Property
7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
Improving Translational Accuracy
9.8K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.8K
Reducing Line Loss
150
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
150
Difference from Background: Limit of Detection
6.1K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
6.1K
Calibration Curves: Linear Least Squares
1.3K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
For data that follow a straight line, the standard method for fitting is the linear...
1.3K
Generalization, Discrimination, and Extinction
510
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
510
