一个外观语义描述器与粗到细的匹配强大的VPR
Jie Chen1, Wenbo Li1, Pengshuai Hou1
1School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110819, China.
Sensors (Basel, Switzerland)
|April 13, 2024
概括
本研究介绍了SemLook,这是一个新的视觉位置识别 (VPR) 框架,它结合了语义和外观信息,以实现更准确的图像匹配. 在具有挑战性的城市环境中,SemLook的性能优于现有方法,提高了定位的准确性和稳定性.
科学领域:
- 计算机视觉 计算机视觉
- 机器人技术 机器人技术 机器人技术
- 人工智能的人工智能
背景情况:
- 语义细分使用外观不变的语义信息进行了先进的视觉位置识别 (VPR).
- 在VPR中,语义封闭和稀疏性等挑战限制了仅依赖语义数据进行本地化.
- 现有的VPR算法在复杂的城市环境中扎,其中包括外观和视角的变化.
研究的目的:
- 提出一个新的VPR框架,SemLook,它集成了语义和外观信息,以提高图像匹配的准确性和稳定性.
- 在有语义封闭和稀疏性的场景中解决仅语义VPR的局限性.
- 为了提高复杂的城市视觉定位的实时性能和准确性.
主要方法:
- 开发了一个粗细的图像匹配策略,使用新的SemLook描述符.
- 从语义轮构建全球SemLook描述符,用于初始图像选,提高准确性和实时性能.
- 引入了本地SemLook描述符,将深度学习提取的外观特征与精细选的语义信息相结合,解决语义重叠和稀疏性.
主要成果:
- 与六个最先进的VPR算法相比,SemLook描述器在三个公共数据集 (扩展CMU季节,机器人汽车季节v2,SYNTHIA) 中表现出更高的性能.
- 在延长CMU季节数据集上达到100%的AUC,在SYNTHIA数据集上达到99%的AUC.
- 该框架有效地处理城市环境中复杂的图像匹配挑战,显示出更高的准确性和稳定性.
结论:
- 建议使用全球和本地SemLook描述符的粗细化策略显著提高了VPR的准确性和稳定性.
- 结合语义和外观信息对于在视觉模两可或稀疏的环境中有效定位至关重要.
- 在具有挑战性的现实场景中,SemLook为可靠的视觉位置识别提供了一个有前途的解决方案.
相关概念视频
Association Areas of the Cortex
5.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.3K
Sign Test for Matched Pairs
131
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
To conduct the sign test, we first calculate the differences in...
131
Structural Classification of Joints
3.4K
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...
3.4K
Depth Perception and Spatial Vision
643
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
643
Functional Classification of Joints
4.1K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.1K
Prosopagnosia
159
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
159


