VIPS:用于人搜索的学习视图不变特征
Hexu Wang1,2, Wenlong Luo3, Wei Wu1
1Xi'an Key Laboratory of Human-Machine Integration and Control Technology for Intelligent Rehabilitation, Xijing University, Xi'an 710123, China.
Sensors (Basel, Switzerland)
|September 13, 2025
概括
视图不变的人员搜索 (VIPS) 通过使用视觉语言模型来识别不同摄像头视图中的个人,提高对视角变化和背景杂乱的稳定性来增强无人机 (UAV) 监视.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 机器人技术 机器人技术 机器人技术
背景情况:
- 无人驾驶飞行器 (UAV) 对监视至关重要,在复杂的环境中捕获多视角数据.
- 在无人机图像中跨平台的人员搜索面临的挑战是由于严重的视角变化,遮蔽和混乱的背景.
研究的目的:
- 为无人机开发一个强大的人员搜索框架,克服观点差异和环境挑战.
- 利用大型视觉语言模型 (VLMs) 来改进交叉视图人身份识别.
主要方法:
- 提出了一个新的两阶段框架,视图不变的人搜索 (VIPS),将Faster R-CNN与视图不变重新识别 (VIReID) 模块集成在一起.
- 使用VLM来实现基于文本的ID描述符和视觉特征之间的语义对齐.
- 引入了一个可学习的面具生成器,用于特征净化和视图提示,用于视角转移编码.
主要成果:
- 在基准数据集上实现了最先进的性能,用于跨平台的人员搜索.
- 除研究证实了单个组件的有效性,包括特征净化和查看提示.
- 通过共享的语义嵌入来证明了强大的交叉视图匹配.
结论:
- VIPS框架显著提高了无人机监视中的人员搜索能力.
- 来自VLM的语义对齐为解决无人机应用中的视角差异提供了有希望的方向.
- 该研究为开发基于无人机的先进实时监控系统提供了见解.
相关概念视频
01:26Causes of Similarity-Dissimilarity Effect
254
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
254
01:29Dark Triad and Person Perception
271
Person perception is influenced by both external behaviors and the observer’s internal characteristics, including personality traits. Individuals with dark personality traits, comprising psychopathy, Machiavellianism, and narcissism — collectively known as the dark triad – exhibit manipulative and exploitative tendencies in social contexts. These traits affect how they perceive others and how they are perceived.The Role of Dark Personality Traits in Person PerceptionBlack et...
271
01:12Hindsight Biases
4.2K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
4.2K
01:03IR Frequency Region: Fingerprint Region
1.9K
IR spectra are divided into two main regions: the diagnostic region and the fingerprint region. The diagnostic region of the spectrum lies above 1500 cm−1. The absorptions resulting from single-bond vibrations of the N–H, C–H, and O–H stretch at higher wavenumbers and appear on the left side of the spectrum. The stretching absorptions of the C≡C and C≡N occur between 2100–2300 cm−1. In contrast, those arising from stretching absorptions of the...
1.9K