语境解和原型继承用于强大的视觉接地
IEEE transactions on pattern analysis and machine intelligence
|December 5, 2023
概括
这项研究引入了强大的视觉接地 (VG) 的新框架,可以改善图像中的目标歧视. 该方法通过解开上下文和继承原型来增强对开放词汇场景的概括性.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 视觉接地 (VG) 从语言查询中识别图像目标,但与上下文歧视和开放词汇泛化作斗争.
- 现有的方法往往忽略了上下文信息,当目标共享类别或出现在新的场景中时,限制了性能.
研究的目的:
- 开发一个强大的视觉接地框架,能够处理标准和开放词汇场景.
- 通过有效利用上下文信息来改善目标对象的歧视.
- 增强对在培训过程中未见过的新型对象和类别的概括.
主要方法:
- 提出一个新的框架,包括背景解和原型继承,用于视觉接地.
- 语境解将参考和上下文特征分开,以改善歧视.
- 原型继承利用原型库来利用已见的数据,特别是在开放词汇的场景中.
- 从脱而出的语言和视觉原型中融合的特征由视觉转换器处理,用于界限框回归.
主要成果:
- 拟议的方法在区分目标方面表现出卓越的表现,即使是同一类别的目标.
- 语境解有效地增强了视觉特征的辨别力.
- 原型继承显著提高了在开放词汇视觉接地任务的性能.
- 广泛的实验证实了该方法在标准场景和开放词汇场景中优于最先进的方法.
结论:
- 这种新的框架提供了一个强大的解决方案,用于在各种场景中进行视觉接地,包括那些具有新对象的场景.
- 语境解和原型继承是实现高性能和通用化的关键组成部分.
- 该方法在视觉接地方面推进了最先进的技术,特别是在具有挑战性的开放词汇场景中.
相关概念视频
Concepts and Prototypes
154
The human nervous system handles vast amounts of information by translating sensory stimuli into neural impulses, which the brain processes, creating thoughts expressed through language or stored as memories. The brain also synthesizes information from emotions and memories, which significantly influence thoughts and behaviors. This intricate process creates a comprehensive mental picture.
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
The brain organizes this information using concepts, which are mental categories grouping linguistic data,...
154
Gestalt Principles of Perception
314
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
314
Perceptual Constancy
402
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
402
Depth Perception and Spatial Vision
673
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
673
Normal and Tangetial Components: Problem Solving
181
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
181
Schemas
11.6K
A schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.
11.6K


