HFM-GS:半面绘制 3DGS 化身基于实时 HMD 移除
IEEE transactions on visualization and computer graphics
|October 2, 2025
概括
本研究引入了一种新的方法,用于在扩展现实 (XR) 应用中移除头部显示器 (HMD). 半脸映射3D高斯斯喷涂化身 (HFM-GS) 方法实现实时,高保真面部恢复,以改善XR用户感知.
科学领域:
- 计算机视觉 计算机视觉
- 扩展现实 (XR)
- 计算机图形 计算机图形
背景情况:
- 在扩展现实 (XR) 中增强用户感知通常需要移除头戴式显示器 (HMD).
- 目前在XR中去除HMD的方法在处理速度和重建精度方面都有局限性.
研究的目的:
- 开发一种实时,高保真的方法,用于在XR视频中恢复被HMD遮住的面孔.
- 提高面部变形的适应能力,提高HMD移除的处理速度.
主要方法:
- 提出了一半面部映射3D高斯斯喷化身 (HFM-GS) 方法来删除HMD.
- 为了变形适应性,在上面和下面的高斯面之间建立了一个映射场.
- 实施了基于关联重量的采样,以提高时间性能和高斯数变化处理.
- 利用高斯分离策略来确保模型的稳定性.
主要成果:
- 与两种最先进的方法相比,HFM-GS方法显示出优越的质量和时间性能.
- 在HMD遮蔽的视频中实现了完整面部的实时和高保真在线恢复.
- 用户研究证实了视觉保真度的显著改善.
结论:
- 在XR应用中,HFM-GS方法为实时,高保真面部修复提供了有效的解决方案.
- 这种方法通过克服HMD遮,显著提高了用户的感知.
- 该方法为现有的HMD移除技术提供了强大的和高效的替代方案.
相关概念视频
Masking and Demasking Agents
3.4K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
3.4K
Facial Feedback Hypothesis
588
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
588


