具有几何语义注意力的多阶段网络,用于双视图对应学习.
概括
这项研究引入了一个新的多阶段几何语义注意 (MSGSA) 网络,用于在图像对应中强大的异常值删除. MSGSA有效处理高达90%异常值的数据集,显著提高了摄像头姿势估计的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 几何深度学习 几何深度学习
背景情况:
- 建立图像对应对于许多计算机视觉任务至关重要.
- 高异常值比率 (高达90%) 对现有的通信方法构成重大挑战.
- 目前的方法很难有效地利用几何转换的一致性和语义邻近信息.
研究的目的:
- 开发一种可靠的方法来消除图像对应中的异常值,特别是在极端异常值条件下.
- 在具有挑战性的场景中提高相机姿势估计的准确性.
- 引入一种新的网络架构,集成几何和语义信息.
主要方法:
- 提出了一个多阶段几何语义注意 (MSGSA) 网络.
- 开发了一个多分支 (MB) 模块,用于各种空间转换.
- 整合了几何转换一致性 (GTC) 模块和使用变压器进行高效信息提取的几何语义注意力 (GSA) 模块.
- 利用基于图形的表示来进行几何语义信息处理.
主要成果:
- 在消除异常值方面,MSGSA显著超过了最先进的方法.
- 在摄像头姿势估计方面表现出卓越的性能,特别是在异常值流行率高的情况下.
- 在YFCC100M和SUN3D数据集上取得了最先进的结果.
结论:
- 该MSGSA网络提供了一个非常有效的解决方案,用于图像对应异常值的删除.
- 拟议的架构成功地整合了几何和语义信息,以提高性能.
- MSGSA提供了一种强大的方法来解决具有显著噪音的挑战性计算机视觉问题.
相关概念视频
01:22Multi-input and Multi-variable systems
544
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
544
01:20Parallel Processing
950
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
950
01:12Observational Learning
1.5K
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
1.5K