指示-ReID++:朝着通用目的的指令引导人重新识别指令
概括
本研究介绍了instruct-ReID,它是个人重新识别 (ReID) 模型的统一任务,可以通过视觉或文字指令检索. 新的方法,IRM和IRM++,在OmniReID++基准上取得了最先进的结果.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
背景情况:
- 人重新识别 (ReID) 研究一直专注于特定的任务,限制了现实世界的适用性.
- 现有的ReID模型在各种场景中扎,例如换衣服或可见红外匹配.
研究的目的:
- 要引入一个一般的ReID任务,instruct-ReID将多个现有的ReID任务统一到一个单一的模型中.
- 开发一种多功能ReID模型,能够根据文本或视觉指令检索图像.
主要方法:
- 提出了指令-ReID任务,通过指令将现有的6个ReID任务视为特殊情况.
- 引入了OmniReID++基准,用于大规模,多样化的ReID数据和评估.
- 开发了IRM (基于指令的检索模型) 与自适应的三重损失和IRM++与内存银行辅助学习.
主要成果:
- 在OmniReID++基准测试中,IRM和IRM++在10个测试集中表现出卓越的性能.
- 在特定任务和无任务评估设置中取得了最先进的结果.
- 提出的方法有效地在统一的框架内处理各种各样的检索任务.
结论:
- Instruct-ReID提供了对个人重新识别的通用方法,提高了模型的适用性.
- 拟议的IRM和IRM++模型代表了统一ReID的重大进展.
- 欧姆尼ReID++基准指标促进了对一般化ReID任务的未来研究.
相关概念视频
01:24Prosopagnosia
122
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
122
02:16Stereotype Content Model
13.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
13.9K