将域识别知识调整为视觉语言模型,用于零射击异常检测
概括
域调整CLIP (DA-CLIP) 通过调整域知识以视觉语言模型来增强零射击异常检测. 这种方法改善了在未见域中检测各种异常的概括性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 零射击异常检测 (ZSAD) 面临的挑战是由于异常的稀有性,多样性和特定领域的表现.
- 视觉语言模型 (VLMs) 对 ZSAD 是有前途的,但由于对特定领域的知识有限,因此在域调整方面遇到了困难.
研究的目的:
- 提出域调整CLIP (DA-CLIP),通过将域意识知识调整到VLMs来增强ZSAD的新方法.
- 提高VLMs的概括能力,用于检测未见域中的异常.
主要方法:
- DA-CLIP采用域识别知识适应 (DAKA) 策略,针对目标域的专业专家.
- 可学习的域意识提示被注入到双路径学习的CLIP编码器和DAKA模块中.
- 这使得专家能够根据异常特征和特定领域的特征进行动态选择和组合.
主要成果:
- 在工业和医疗领域的基准数据集上,DA-CLIP的表现始终优于最先进的方法.
- 在图像级和像素级异常检测任务中观察到显著的改进.
- 双通道学习有效地捕捉到特定领域的特征,以便更好地适应.
结论:
- 在零射击异常检测中,DA-CLIP为域调整提供了强大的解决方案.
- 拟议的DAKA策略和域意识提示提高了在各种异常检测任务上的VLM性能.
- 这种方法通过改善跨不同领域的概括性来推进ZSAD领域.
相关概念视频
Vision
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Elastic Collisions: Introduction
An elastic collision is one that conserves both internal kinetic energy and momentum. Internal kinetic energy is the sum of the kinetic energies of the objects in a system. Truly elastic collisions can only be achieved with subatomic particles, such as electrons striking nuclei. Macroscopic collisions can be very nearly, but not quite, elastic, as some kinetic energy is always converted into other forms of energy such as heat transfer due to friction and sound. An example of a nearly...
Elastic Collisions: Case Study
Elastic collision of a system demands conservation of both momentum and kinetic energy. To solve problems involving one-dimensional elastic collisions between two objects, the equations for conservation of momentum and conservation of internal kinetic energy can be used. For the two objects, the sum of momentum before the collision equals the total momentum after the collision. An elastic collision conserves internal kinetic energy, and so the sum of kinetic energies before the collision equals...
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Force Classification
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...

