收回:iMetaTown:一个基于虚拟现实的多个交互功能元宇宙系统.
IEEE transactions on visualization and computer graphics
|March 4, 2024
概括
本研究介绍了一个实时虚拟现实 (VR) 系统,用于Metaverse人机交互 (HCI). 它使用2D自主监督学习 (2DASL) 来进行3D面部重建,增强用户参与度和交互质量.
科学领域:
- 计算机科学 计算机科学
- 虚拟现实 虚拟现实 虚拟现实
- 人与计算机的交互
背景情况:
- 开发沉浸式和交互式的Metaverse体验需要先进的人机交互 (HCI) 系统.
- 现有的系统经常在现实和实时的3D化身表示和交互方面扎.
研究的目的:
- 开创使用虚拟现实 (VR) 的实时交互和沉浸式Metaverse HCI系统.
- 通过一种新的3D面部重建方法来增强玩家与玩家的互动.
- 使用2D自主监督学习 (2DASL) 方法优化3D模型学习和面部对齐.
主要方法:
- 实施了基于弱监督学习的3D面部重建方法.
- 使用2D自主监督学习 (2DASL) 方法,使用2D面部图像来改进3D模型的学习.
- 通过区块链开发了用于用户交互 (拥抱,握手) 和通信 (语音,文本) 的功能模块.
- 解决了管理多个同时在线用户的挑战.
主要成果:
- 2DASL面部重建方法显著改善了3D面部对齐和交互能力.
- 实验系统在个人电脑上实现了实时处理速度 (高达18fps).
- 用户反显示了社会接受,互动可用性,情感表达和整体满意度的高分.
结论:
- 开发的VR HCI系统通过优化的3D面部建模有效地增强了Metaverse交互.
- 该系统展示了实时性能和高用户接受度,为更具吸引力的虚拟体验铺平了道路.
- 2DASL方法为VR HCI应用中的3D面部重建提供了强大的解决方案.
相关概念视频
Virtual Work for a System of Connected Rigid Bodies
384
Virtual work is a powerful method used to solve problems involving several connected rigid bodies. When the system is in equilibrium, virtual work is zero. This allows the calculation of the resulting forces when a system undergoes a virtual displacement. When attempting to analyze such a system, first, use a free-body diagram, where an independent coordinate represents the configuration of the links, and mark its deflected position resulting from the positive virtual displacement.
Next,...
Next,...
384
Virtual Work
834
The principle of virtual work states that if a body is in static and dynamic equilibrium, then the sum of all the virtual work done by all external forces and couple moments for any given virtual displacement must be zero.
In static equilibrium, a body can experience an imaginary or virtual movement, such as displacement or rotation. The virtual work done by a force is equal to the dot product of force and virtual displacement in the direction of the force. When it comes to virtually rotating a...
In static equilibrium, a body can experience an imaginary or virtual movement, such as displacement or rotation. The virtual work done by a force is equal to the dot product of force and virtual displacement in the direction of the force. When it comes to virtually rotating a...
834
Metacognition
156
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
156
Visual System
581
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
581
Functional Brain Systems: Reticular Formation
1.9K
The reticular formation is a complex network of gray and white matter located within the brainstem extending from the medulla to the midbrain.
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
Within the reticular formation, there are several distinct nuclei that can be classified into three broad categories. The Raphe nuclei are located along the midline of the brainstem. They are primarily known for their role in synthesizing and releasing serotonin, a neurotransmitter involved in regulating mood, appetite, sleep, and circadian rhythms. The...
1.9K
Transition Zone
90
The transition zone in concrete is a critical area where aggregate meets cement paste, marked by a distinct porosity and weakness compared to the surrounding material. The adhesion around the aggregates is primarily due to Van Der Waals forces. The voids within this zone influence its robustness; initially, it is less durable than the surrounding bulk mortar due to larger voids. Initially, when concrete is compacted, a higher water-cement ratio near the aggregates leads to the formation of...
90


