统一的模式分离:无监督域调整的视觉语言框架
IEEE transactions on pattern analysis and machine intelligence
|August 22, 2025
概括
这项研究引入了使用视觉语言模型 (VLM) 的无监督域适应 (UDA) 的新框架. 它有效地解决了模式差距,提高了跨领域任务的性能和计算效率.
科学领域:
- 人工智能
- 计算机视觉
- 自然语言处理
背景情况:
- 无监督域调整 (UDA) 旨在将模型从标记的源域推广到未标记的目标域.
- 预先训练的视觉语言模型 (VLM) 通过对齐视觉和文本嵌入来显示UDA的前景,但模式差距阻碍了性能.
- 与VLM直接的UDA通常只传输模式不变的知识,从而导致低于最佳的结果.
研究的目的:
- 提出一个统一的UDA框架,解决VLM的模式差距.
- 为了更好的适应,分离和单独处理模式特定和模式不变的组件.
- 为样本分类和目标调整引入一种模式差异指标.
主要方法:
- 一个统一的模式分离框架被提议将VLM特征分为特定于模式和不变的组件.
- 在测试时确定适应模式的组合重量,以最大限度地提高组件协同作用.
- 一种模式差异度量对样本进行分类,使得可针对性地使用模式不变样本进行对齐和不确定样本进行注释.
主要成果:
- 拟议的框架可以在UDA任务中实现高达9%的绩效提升.
- 与现有方法相比,该方法的计算效率提高了9倍.
- 不同环境中的实验证实了该框架的有效性和稳定性.
结论:
- 统一的模式分离框架有效地弥合了UDA的VLM模式差距.
- 该方法通过利用特定模式和不变知识来增强跨领域的概括性.
- 这项工作为VLM的UDA提供了计算效率高的解决方案.
相关概念视频
Language and Cognition
440
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
440
Language Development
447
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
447
Components of Language
392
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
392
Visual System
685
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
685
Vision
55.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.3K
Sensory Modalities
1.5K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.5K


