多查询图像检索的层次匹配和推理
概括
本研究介绍了用于多查询图像检索 (MQIR) 的等级匹配和推理网络 (HMRN). HMRN通过考虑文本查询和图像区域之间的等级相似性和语义相关性来提高图像检索准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 信息检索 信息检索
背景情况:
- 多查询图像检索 (MQIR) 能够使用特定图像区域的多个文本描述来搜索相关图像.
- 当前的MQIR方法往往忽视层次相似性和高级语义相关性,导致图像-文本对齐不完整.
- 现有的方法主要集中在单一层次的相似性上,未能捕捉到有效检索所需的细微关系.
研究的目的:
- 提出一个新的等级匹配和推理网络 (HMRN),以解决现有的MQIR方法的局限性.
- 通过结合层次语义表示和探索区域-查询对之间的语义相关性来增强MQIR.
- 为了提高图像检索的准确性和完整性,以响应多个特定区域的文本查询.
主要方法:
- 开发了一个等级匹配和推理网络 (HMRN),将MQIR解成三个等级语义表示:本地细节,全球上下文和固有的相关性.
- 实施了基于标尺的匹配 (SM) 模块,以实现多级别的对齐相似性,包括细粒度的本地和上下文意识的全球级别.
- 引入了基于矢量推理 (VR) 模块,以揭示多个区域查询对之间的语义相关性,捕捉高层推理相似性.
主要成果:
- 拟议的HMRN在基准数据集上明显优于当前最先进的方法.
- 在R@1指标中,与之前的最佳方法,钻井.down相比,实现了23.4%的大幅改善.
- 证明了整合层次相似性和语义推理以获得更高的MQIR性能的有效性.
结论:
- 通过结合层次匹配和推理,HMRN有效地解决了现有的MQIR方法的局限性.
- 该网络能够捕获细粒度的局部细节,上下文的全球范围和高层相关性,这导致了卓越的检索准确性.
- 拟议的方法代表了多查询图像检索技术的重大进步.
更多相关视频
05:49Author Spotlight: Advancing CBCT and Digital Dental Image Integration with AI-Assisted Digitization
Published on: February 23, 2024
839
07:26Executing Complexity-Increasing Queries in Relational MySQL and NoSQL MongoDB and EXist Size-Growing ISO/EN 13606 Standardized EHR Databases
Published on: March 19, 2018
9.3K
相关概念视频
Collisions in Multiple Dimensions: Problem Solving
4.2K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.2K
ER Retrieval Pathway
3.8K
In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
3.8K
Collisions in Multiple Dimensions: Introduction
5.4K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
5.4K
Imaging Biological Samples with Optical Microscopy
4.7K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
4.7K
