OmniSketch:以素描为导向的文本到3D生成,具有高准确度的几何和纹理
IEEE computer graphics and applications
|February 23, 2026
概括
OmniSketch通过使用三阶段管道从草图和文本生成3D模型. 这种新的框架增强了3D内容创作,提高了几何真实性和纹理一致性.
科学领域:
- 计算机视觉 计算机视觉
- 3D 图形 3D 图形
- 人工智能的人工智能
背景情况:
- 数字化依赖于从抽象概念快速生成3D内容.
- 基于草图和文本到3D生成的挑战包括稀疏的输入,缺乏纹理和数据集错位.
研究的目的:
- 介绍OmniSketch,这是一个以草图为导向的文本到3D生成的框架.
- 解决当前跨模式3D合成中的局限性.
- 在生成的3D模型中提高几何真实性和纹理一致性.
主要方法:
- 一个三阶段的管道:条件扩散用于参考视图生成,修正流用于高准确度几何,以及几何导向合成用于纹理.
- 合并草图结构约束与语义描述.
- 使用多视图图像合成来获得视图一致的纹理.
主要成果:
- 在几何精度和纹理一致性方面,OmniSketch超越了最先进的方法.
- 从草图和文本生成3D模型的表现卓越.
- 成功构建了一个多模拟草图到3D数据集和交互平台.
结论:
- 拟议的OmniSketch框架有效地解决了以草图为指导的3D内容生成方面的挑战.
- 该方法可以实现高质量的3D模型,具有精确的几何和一致的纹理.
- OmniSketch促进了数字内容创建和交互式应用的进步.
相关概念视频
Guidelines for Sketching a Curve
187
Curve sketching is a systematic method for understanding the overall behavior of a function by analyzing its key mathematical features. A function defines a curve on the coordinate plane, where the horizontal axis represents the input variable and the vertical axis represents the output. The process begins by determining the domain, which specifies the set of input values for which the function is defined and establishes the horizontal extent of the graph.Intercepts with the horizontal and...
187
Three-Dimensional Force System:Problem Solving
1.4K
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
1.4K
Three-Dimensional Force System
2.9K
In mechanical engineering, a three-dimensional force system is a system of forces acting in three dimensions, with forces applied along the x, y, and z coordinate axes. The three-dimensional force system is an important concept in mechanical engineering, as it allows engineers to understand and analyze the behavior of objects and structures in three dimensions. By understanding the forces acting on a system, engineers can design more efficient and effective mechanical systems that can withstand...
2.9K


