通过双层知识蒸检测几拍图形异常.
Xuan Li1, Dejie Cheng1, Luheng Zhang1
1National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, Chengdu 610065, China.
Entropy (Basel, Switzerland)
|January 24, 2025
概括
这项研究介绍了DualKD,这是一种使用双层知识蒸检测图形异常的新方法. 通过有效地将知识从辅助数据集转移到目标数据集,提高性能,DualKD增强了少量学习.
科学领域:
- 图形分析图形分析
- 机器学习 机器学习
- 数据科学是数据科学.
背景情况:
- 在许多领域,图形异常检测至关重要,但获取标记数据是具有挑战性和昂贵的.
- 简单的学习提供了一个解决方案,要求最小的标记数据,但传统模型往往不充分利用辅助信息.
- 现有的几拍图形异常检测方法的低于最佳性能源于对辅助数据集的不完全利用.
研究的目的:
- 提出DualKD,一个双层知识蒸方法用于图形异常检测.
- 在图形异常检测中增强少数射击学习模型的概括能力.
- 为了解决在利用辅助数据方面,传统的几次射击模型的局限性.
主要方法:
- 一个教师模型被训练来生成软标签 (预测分布),以捕捉数据的不确定性.
- 一个学生模型使用这些软标签进行训练,以学习详细的节点特性.
- 双重表示蒸 (短和长) 用于将知识从辅助集合转移到目标集合.
主要成果:
- 在图形异常检测方面,DualKD显著优于先进的基线方法.
- 拟议的方法在四个实验数据集中显示了增强的识别性能.
- 知识蒸有效地提高了少数镜头图形异常检测的概括能力.
结论:
- 通过有效利用双层知识蒸,DualKD提供了一种优越的方法来检测几次图形异常.
- 该方法成功地转移了知识,与现有技术相比,提高了性能.
- 在图形异常检测中,DualKD为具有有限标记数据的场景提供了强大的解决方案.
相关概念视频
Difference from Background: Limit of Detection
5.8K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.8K
Differential Leveling
133
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
133
Generalization, Discrimination, and Extinction
424
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
424
Introduction and Methods of Leveling
61
Leveling is a surveying procedure used to determine elevation differences between distant points. Elevation refers to the vertical distance above or below a reference datum, typically mean sea level (MSL). In the United States, elevations are often referenced to the mean sea level station at Father Point Rimouski along the St. Lawrence Seaway. To make the datum accessible, permanent markers are established throughout the region. These markers, called benchmarks, have known elevations. If the...
61
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
Associative Learning
285
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
285


