任何区域都可以在旋转借口任务上使用完全旋转和加权区域混合来平等有效地感知
概括
本研究介绍了FullRot和WRMix,这两种新的自我监督学习方法通过专注于代表性不足的图像区域和增加任务复杂性来改善视觉表现. 综合方法显著提高了分类,细分和对象检测任务的性能.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 自主监督学习 (SSL) 是一种关键的技术,用于在没有手动注释的情况下进行视觉表示学习.
- 旋转预测是一个常见的SSL借口任务,但它可以忽略中央图像特征.
- 现有的方法可能无法充分利用各种图像区域来实现强大的特征学习.
研究的目的:
- 为了解决SSL中旋转预测的局限性,特别是中心图像特征的边缘化.
- 提出一种新的SSL方法,FullRot,可以增强代表性不足的图像区域的学习.
- 引入WRMix,一种数据混合技术,以改善从各种图像部分的特征学习.
主要方法:
- FullRot:一种新的SSL方法,涉及图像区域的调整大小和裁剪,在圆形作物上应用无度旋转.
- WRMix:一种数据混合技术,将两个随机的图像内补丁合并在一起.
- 组合方法:FullRot + WRMix应用于视觉表示学习的借口任务.
主要成果:
- 在多个任务和数据集中,FullRot + WRMix超过了最先进的SSL方法.
- 在分类 (如STL-10上+13.98%),细分 (如VOC2012上+32.44%mIoU) 中观察到显著的准确性改进.
- 在十个基准数据集上表现出卓越的表现,包括CIFAR-10,Sports-100和VOC 2007.
结论:
- 拟议的FullRot和WRMix方法有效地克服了SSL中传统旋转预测的局限性.
- 结合的方法导致更强大和更全面的视觉表示.
- 这项工作为自主监督的视觉表现学习设定了新的基准.
相关概念视频
Principal Moments of Area
1.1K
In mechanics, the product of inertia and moments of inertia of area help to calculate the stability and performance of various structures and components. The coordinate transformation relations are used to calculate the moments and products of inertia for an area about the inclined axes. Further, the moments and products of inertia with respect to the principal axes can be determined using the moments and products of inertia about the inclined axes.
The principal moment of inertia axes are the...
The principal moment of inertia axes are the...
1.1K
Area Computation by the Alternative Coordinate Method
52
The alternative coordinate method, also known as the Shoelace Formula, is a technique for determining the area of a traverse using Cartesian coordinates. This method relies on the sequential arrangement of x and y coordinates for each point of the shape, ensuring accuracy and ease of application.In this approach, each corner's x and y coordinates are listed as fractions, with the x-coordinate as the numerator and the y-coordinate as the denominator. These coordinates are arranged sequentially...
52
Depth Perception and Spatial Vision
631
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
631
Perceptual Constancy
385
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
385
Factors Affecting Perception
1.6K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.6K
Moments of Inertia for Composite Areas
1.0K
Composite areas are structures with multiple basic shapes connected in some way. These shapes usually include rectangles, triangles, circles, and other basic shapes that are connected in such a way as to form a single structure. Calculating the second moment of area for a composite area is essential when trying to understand the structure's overall stiffness.
The second moment of area, also known as the moment of inertia, measures a structure's resistance to bending. It is calculated by...
The second moment of area, also known as the moment of inertia, measures a structure's resistance to bending. It is calculated by...
1.0K


