增强双模式匹配与视觉语言表示,用于分布外检测
概括
本研究引入了双模式匹配 (DPM) 以使用视觉语言模型 (VLM) 改进分布外 (OOD) 检测. DPM有效地使用视觉和文本数据模式,大大提高了对未见数据分布的模型概括性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 分布外 (OOD) 检测对于可靠的机器学习模型部署至关重要.
- 像CLIP这样的视觉语言模型 (VLM) 显示出由于多式模式表示的OOD检测的前景.
- 现有的基于CLIP的方法往往忽略了分布中的视觉线索,从而限制了性能.
研究的目的:
- 开发一种新的方法,通过将视觉和文字在分发 (ID) 信息结合起来,通过使用CLIP来增强OOD检测.
- 提出双模式匹配 (DPM),利用这两种模式进行强大的OOD检测.
主要方法:
- 拟议的双模式匹配 (DPM) 方法用于OOD检测.
- 使用域特定特征聚合 (DSFA) 和快速增强 (PE) 模块来改进功能.
- 存储类智能文本特征作为文本模式和汇总的ID视觉特征作为视觉模式.
- 针对OOD识别的文本和视觉模式计算了相似度得分.
主要成果:
- 与最先进的方法相比,DPM在多个基准测试中表现优越.
- 结合ID视觉信息被证明是最大限度地提高CLIP的OOD检测能力的关键.
- 轻量化适应机制进一步提高了DPM的OOD检测性能.
结论:
- 拟议的双模式匹配 (DPM) 为OOD检测提供了一个简单而强大的框架.
- 利用多式联运信息,特别是视觉和文本ID模式,对于OOD检测非常有效.
- DPM在具有挑战性的OOD检测场景中推进了视觉语言表示的应用.
相关概念视频
Difference from Background: Limit of Detection
7.1K
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
7.1K
Sign Test for Matched Pairs
210
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
210
Vision
55.4K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.4K
Detection of Black Holes
2.3K
Although black holes were theoretically postulated in the 1920s, they remained outside the domain of observational astronomy until the 1970s.
Their closest cousins are neutron stars, which are composed almost entirely of neutrons packed against each other, making them extremely dense. A neutron star has the same mass as the Sun but its diameter is only a few kilometers. Therefore, the escape velocity from their surface is close to the speed of light.
Not until the 1960s, when the first neutron...
Their closest cousins are neutron stars, which are composed almost entirely of neutrons packed against each other, making them extremely dense. A neutron star has the same mass as the Sun but its diameter is only a few kilometers. Therefore, the escape velocity from their surface is close to the speed of light.
Not until the 1960s, when the first neutron...
2.3K
Detection of Gross Error: The Q Test
6.4K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.4K
Learning Disabilities
274
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
Dyslexia
Dyslexia is a...
274


