部分场景文本检索 部分场景文本检索
概括
这项研究引入了一种用于部分场景文本检索的新型网络,可以同时搜索图像中的文本行和部分补丁. 排名MIL和动态部分匹配算法显著提高了检索准确性和效率.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人工智能的人工智能
背景情况:
- 由于培训数据中缺乏补丁注释,部分场景文本的检索具有挑战性.
- 现有的方法仅限于文本行实例,未能解决部分补丁检索.
- 这种限制阻碍了需要细粒度文本本化和识别的应用程序.
研究的目的:
- 开发一个能够同时从场景图像中检索文本行实例和部分补丁的网络.
- 解决现有方法在处理部分文本实例的局限性,而不需要明确的补丁注释.
- 为了提高部分场景文本检索的效率和准确性.
主要方法:
- 一个新的网络,将查询文本和场景文本实例嵌入到共享功能空间中,用于跨模式相似度测量.
- 多重实例学习 (MIL) 适用于部分补丁相似性学习,没有额外的注释.
- 排名MIL (RankMIL) 来过噪音样本和动态部分匹配算法 (DPMA) 来进行高效的推断.
主要成果:
- 提出的方法在英语和中文数据集上实现了最先进的性能,用于文本行和部分补丁检索任务.
- 观察到平均精度 (mAP) 的显著改善,英语高达8.04%和12.71%,中文高达24.45%和38.06%.
- 该RankMIL和DPMA组件有效地减少噪音和提高搜索效率.
结论:
- 开发的网络有效地解决了部分场景文本检索的挑战,通过整合文本线和部分补丁搜索.
- 新的RankMIL和DPMA方法在部分文本检索的准确性和效率上都取得了重大进展.
- 该方法在不同语言和数据集中展示了强大的概括能力,为更强大的场景文本理解铺平了道路.
相关概念视频
Extraction: Advanced Methods
398
Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is...
398
ER Retrieval Pathway
3.7K
In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
3.7K
Relative Motion Analysis using Rotating Axes-Problem Solving
382
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
Here, in order to determine the magnitude of velocity and acceleration for point...
382
Relative Motion Analysis - Velocity
334
A stroke engine has a slider-crank mechanism that converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider.
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
334
Positron Emission Tomography
4.0K
Positron emission tomography (PET) is a medical imaging technique involving radiopharmaceuticals — substances that emit short-lived radiation. Although the first PET scanner was introduced in 1961, it took 15 more years before radiopharmaceuticals were combined with the technique and revolutionized its potential.
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
One of the main requirements of a PET scan is a positron-emitting radioisotope, which is produced in a cyclotron and then attached to a substance used by the part of the body...
4.0K
The Retinoblastoma Gene
4.0K
Tumor suppressor genes are normal genes that can slow down cell division, repair DNA mistakes, or program the cells for apoptosis in case of irreparable damage. Hence, they play an essential role in preventing the proliferation of damaged cells.
The first-ever tumor suppressor gene called Rb was identified in retinoblastoma - a rare eye tumor in children. In inherited forms of the disease, a child inherits one defective copy of the Rb gene, which predisposes them to retinoblastoma. However,...
The first-ever tumor suppressor gene called Rb was identified in retinoblastoma - a rare eye tumor in children. In inherited forms of the disease, a child inherits one defective copy of the Rb gene, which predisposes them to retinoblastoma. However,...
4.0K


