持续审查和及时纠正:通过自我不真实和阶级明智的蒸来提高对噪音标签的抵抗力
IEEE transactions on pattern analysis and machine intelligence
|December 29, 2025
概括
深度神经网络可以过度适应错误标记的数据. 我们引入了自我不真实蒸 (SNTD) 和SNTD+以不断纠正学习知识,通过噪音标签提高准确性.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 深度神经网络很强大,但容易过度匹配,特别是在错误标记的数据中.
- 记忆效应导致网络首先学习正确的标签,然后学习不正确的标签.
- 早期停止减轻过度装配,但不能完全防止适应不正确的标签或纠正错误.
研究的目的:
- 在深度神经网络中开发一种持续审查和纠正学习知识的机制.
- 为了应对被错误标记的数据所造成的过度配合和记忆的挑战.
- 在有标签噪音的情况下提高深度学习模型的稳定性.
主要方法:
- 引入了自我不真实蒸 (SNTD),一种使用自我蒸来审查和加强正确标签的新方法.
- 在蒸过程中,SNTD掩盖了真实标签,专注于纠正来自非真实类别的错误知识.
- 拟议的SNTD+,包括分类蒸和动态重量调整,以提高性能.
主要成果:
- SNTD使网络能够反复重新访问和加强准确的信息,同时纠正错误标记数据中的不准确性.
- 通过选择特定班级的教师网络和动态调整指导权重,SNTD+提高了强度.
- 提出的方法在处理标签噪声的复杂场景方面取得了显著的改进.
结论:
- 对于面临标签噪声的深度神经网络,持续的审查和纠正机制是必不可少的.
- SNTD和SNTD+提供了有效的策略来减轻记忆效应并提高模型准确性.
- 在SNTD+中,对班级的明智和动态的调整对于处理多样化的学习轨迹和不同的教师影响至关重要.
更多相关视频
06:04Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
Published on: March 24, 2023
05:48Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
Published on: August 9, 2024
相关概念视频
Stereotype Threat and Self-fulfilling Prophecies
41.9K
When we hold a stereotype about a person, we have expectations that he or she will fulfill that stereotype. A self-fulfilling prophecy is an expectation held by a person that alters his or her behavior in a way that tends to make it true. When we hold stereotypes about a person, we tend to treat the person according to our expectations. This treatment can influence the person to act according to our stereotypic expectations, thus confirming our stereotypic beliefs. Research by Rosenthal and...
41.9K
Force Classification
2.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
2.2K
Difference from Background: Limit of Detection
8.0K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
8.0K
Classification of Signals
1.3K
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
1.3K
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Survival Tree
369
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
369
