MineVRA:通过情境意识的方法探索生成AI驱动的内容开发在XR环境中的作用
IEEE transactions on visualization and computer graphics
|March 21, 2025
概括
生成型人工智能 (GenAI) 提供了一种新的方式,可以为沉浸式扩展现实 (XR) 环境创建个性化的3D资产. 一个新的框架,MineVRA,表明GenAI可以有效地补充现有的3D库,增强以用户为中心的XR设计.
科学领域:
- 人工智能 (AI),计算机视觉 (CV),计算机图形 (CG) 和扩展现实 (XR) 的交叉点.
- 在沉浸式数字环境中的人机交互 (HCI).
背景情况:
- 为XR创建个性化的3D资产具有挑战性,通常依赖于手动建模.
- 生成性人工智能 (GenAI) 为自动化,上下文意识的内容生成提供了一个潜在的解决方案.
- 现有的3D资产库可能无法完全满足XR中个性化,适应性内容的需求.
研究的目的:
- 介绍MineVRA,这是一款使用GenAI进行3D资产创建的全新的Human-In-The-Loop (HITL) XR框架.
- 与传统来源相比,评估GenAI生成的3D资产的有效性和用户满意度.
- 探索GenAI对以人为中心的XR开发的设计含义.
主要方法:
- 开发了MineVRA,这是一个多式联通GenAI框架,用于XR中的自适应3D内容生成.
- 整合了GenAI与Human-In-The-Loop (HITL) 流程,以实现连贯的资产创建.
- 进行了一项比较用户研究,评估GenAI生成的资产与沉浸式环境中的Sketchfab资产.
主要成果:
- 基因人工智能生成的3D对象的性能和用户满意度与传统来源的资产相提并论.
- MineVRA框架成功地促进了连贯和自适应的3D内容生成.
- 用户研究结果表明,GenAI可以显著增强传统的3D资产库.
结论:
- 通过像MineVRA这样的框架集成的GenAI提供了一个强大的工具,可以在XR中创建个性化的3D资产.
- 这些发现支持使用GenAI来增强以人为中心和适应性沉浸式环境的发展.
- 这种方法对XR内容创建和用户体验的未来具有宝贵的设计意义.
相关概念视频
Non-equilibrium in the Cell
4.1K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.1K
Stereotype Content Model
13.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
13.9K
Nonconscious Mimicry
4.5K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
4.5K
Morphogenesis
24.2K
Plant morphogenesis—the development of a plant’s form and structure—involves several overlapping developmental processes, including growth and cell differentiation. Precursor cells differentiate into specific cell types, which are organized into the tissues and organ systems that make up the functional plant.
24.2K
Genetic Material
1.8K
Within the human body, a complex and detailed system of trillions of cells works in unison to sustain life. Each cell houses a nucleus, which contains 46 chromosomes divided into 23 pairs. Chromosomes are highly coiled structures made of the genetic material DNA. These chromosomes are essential carriers of genetic information, with half inherited from the mother through her egg and the other half from the father's sperm, combining to create the unique genetic makeup of an individual.
1.8K
The Sense of Self: Reflected Self-Appraisal and Social Comparison
49.5K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
49.5K


