ConvMatch:重新思考网络设计的双视图对应学习学习
IEEE transactions on pattern analysis and machine intelligence
|November 20, 2023
概括
本研究介绍了ConvMatch,一种使用卷积神经网络 (CNN) 克服多层感知子 (MLP) 中的上下文限制的新型通信学习网络. ConvMatch增强了运动向量的准确性,以改善相对姿势和视觉定位任务.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 多层感知器 (MLP) 是双视图对应学习的常见骨干,在单个特征提取方面表现出色,但缺乏固有的上下文.
- 现有的方法往往将上下文捕获模块附加到MLP中,但性能仍然受到脊柱固有的无法汇总上下文的限制.
研究的目的:
- 设计一个新的通信学习网络,ConvMatch,利用卷积神经网络 (CNN) 骨干进行固有的上下文聚合.
- 通过通过密集的运动场来隐式调整假定运动向量来提高运动向量估计的准确性.
主要方法:
- ConvMatch采用了CNN的骨干,使得内在的语境聚合能够用于通信学习.
- 它将稀疏运动向量转换为密集运动场,调整假定向量,并使用CNN来纠正异常值引起的局部错误.
- 全球信息注入和双边卷积被引入,以更好地适应空间转换和处理运动场不连续性.
主要成果:
- ConvMatch在估计正确的运动向量从纠正的运动场中表现出卓越的性能.
- 该网络在关键计算机视觉任务中始终优于最先进的方法.
结论:
- 通过利用CNN进行有效的上下文聚合,ConvMatch在通信学习方面取得了重大进展.
- 提出的方法在相对姿势估计,同位素估计和视觉定位方面取得了最先进的结果.
相关概念视频
Vector Algebra: Graphical Method
12.2K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
12.2K
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.1K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.1K
Associative Learning
407
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
407
Vector Algebra: Method of Components
13.9K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
13.9K
Reducing Line Loss
155
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
155
Design Example: Measuring Distance Between Two Points with Obstructions
41
When measuring distances in areas with physical obstructions, such as a lake in a field, surveyors must employ techniques to calculate accurate lengths without direct line measurements. One effective method is the offset technique, which allows for precise distance estimation over inaccessible stretches.In this scenario, a surveyor must measure a side of an area that crosses a lake. Since the measuring tape cannot span the lake, the surveyor begins by establishing a baseline that aligns with...
41


