重新考虑可学习的细粒度文本提示,用于在视觉语言模型中检测少数镜头异常
Delong Han1, Luo Xu1, Mingle Zhou1
1Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center (National Supercomputer Center in Jinan), Qilu University of Technology (Shandong Academy of Sciences), Jinan, 250353, China; Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science, Jinan, 250014, China.
概括
本研究引入了在工业环境中用于少数拍摄异常检测 (FSAD) 的新框架,利用细粒度可学习的文本提示. 该方法提高了准确性和概括性,在有限的数据中识别工业缺陷.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 工业质量控制 工业质量控制
背景情况:
- 少数拍摄异常检测 (FSAD) 对于具有有限训练样本的工业图像分析至关重要.
- 当前的FSAD方法通常依赖于视觉语言模型的广泛的手动提示工程,限制了准确性和概括性.
- 培训和测试数据集之间的域差距阻碍了在跨数据集检测中文字提示的性能.
研究的目的:
- 开发一个统一的工业FSAD框架,使用细粒度可学习的文本提示.
- 提高工业图像中异常检测的准确性和稳定性.
- 为了克服手动提示工程和FSAD中域名转移的局限性.
主要方法:
- 提出了一种具有注册损失的细粒度文本提示适配器 (FTPA),以优化文本提示以捕获细粒度语义信息.
- 引入了一个动态调制机制 (DMM),以自适应调制图像和文本提示分支,减轻后训练错误和域不可知问题.
- 将FTPA和DMM集成到一个视觉语言模型框架中,用于增强FSAD.
主要成果:
- 在短暂的工业异常检测和细分方面实现了最先进的性能.
- 证明了高准确性,AUROC分数为98.3%的分类和96.3%的细分,在MVTec-AD.上的4次拍摄设置中.
- 在Visa数据集上实现了93.8%的分类AUROC和97.9%的四拍设置细分.
结论:
- 拟议的细粒度可学习的文本提示框架显著提高了FSAD在工业应用中的性能.
- FTPA和DMM有效地解决了有限数据,手动提示限制和域泛化的挑战.
- 该方法为工业异常检测和细分任务提供了强大而准确的解决方案.
相关概念视频
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Difference from Background: Limit of Detection
5.9K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
5.9K
Language Development
318
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
318


