基于VR在线平台的多模式融合的动作认可
Xuan Li1, Hengxin Chen1, Shengdong He1
1College of Computer Science, Chongqing University, Chongqing, 400044 China.
概括
本研究引入了一种新的方法,用于收集和识别虚拟现实 (VR) 在线通信中的用户行为. 开发的多式联络融合模型在识别用户行为方面实现了高准确性,增强了虚拟交互中的现实性.
科学领域:
- 人与计算机的交互
- 虚拟现实 虚拟现实 虚拟现实
- 计算机视觉 计算机视觉
背景情况:
- 在线沟通缺乏面对面互动的丰富性.
- 目前的虚拟现实 (VR) 平台使用化身,但缺乏现实的用户动作跟踪.
- 对于VR用户的行为,需要有效的数据收集方法来进行决策.
研究的目的:
- 开发一种方法来收集VR用户的多式联运行动数据.
- 为VR环境创建一个高精度的动作识别模型.
- 为了增强基于虚拟现实中的化身通信的现实性.
主要方法:
- 采集了使用VR头部显示器 (HMD) 传感器,RGB摄像头和人类姿势估计的9个动作中的3种模式.
- 采用先进的多式联通融合网络进行动作识别.
- 使用VR HMD的3D位置数据设计了一个2D关键点增强方案.
主要成果:
- 使用多式联接实现了高精度的动作识别模型.
- 证明增强的2D关键点数据和VR HMD传感器数据可以产生准确和稳定的动作识别模型.
- 对课堂场景进行专注的数据收集和实验,具有更广泛应用的潜力.
结论:
- 拟议的方法有效地收集和识别VR用户的行为,提高沟通现实性.
- 多模式融合方法和数据增强技术提高了模型的准确性和稳定性.
- 研究结果适用于课堂环境,并可扩展到其他VR环境.
相关概念视频
Masking and Demasking Agents
2.5K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.5K
Association Areas of the Cortex
5.6K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.6K
Force Classification
1.3K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.3K


