Related Experiment Videos
HiFiVe: High-fidelity vehicle generation leveraging auto-regressive 2D generative priors
Hongli Xiao1, Youjian Zhang2, Qi Zheng3
1MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University, Shanghai, 200240, China; Academy of Military Science, Beijing, 100071, China; College of Computer Science and Technology, National University of Defense Technology, Changsha, 410073, China.
Abstract:
Existing 3D vehicle generation methods often suffer from low geometric fidelity and blurry textures, hindering their downstream applications. While recent works adopt multi-view diffusion models for high-fidelity texture, they are often constrained by fixed viewpoints, limited resolution, and a reliance on costly fine-tuning to achieve cross-view consistency. In this paper, we propose HiFiVe, a training-free framework for high-fidelity vehicle modeling through joint texture and geometry enhancement by imposing 3D geometric constraints to anchor 2D generative priors. Specifically, we propose an auto-regressive texture refinement pipeline that progressively synthesizes high-resolution textures from arbitrary viewpoints. To ensure cross-view consistency, the coarse geometry serves as a synchronization prior, conditioning each generation step on previously synthesized frames via depth-based warping and multi-view texture fusion. Moreover, the inherent symmetry of vehicles is exploited to mitigate error accumulation. Finally, high-frequency surface details are recovered by refining the mesh geometry using normal maps estimated from the enhanced textures. Extensive experiments on synthetic and real-world vehicle datasets demonstrate that our method significantly improves both geometric detail and texture quality compared to state-of-the-art baselines.
Related Concept Videos
Maximizing the Directional Derivative
Multi-input and Multi-variable systems
In the absence of...
Reconstruction of Signal using Interpolation
Transformers with Off-Nominal Turns Ratios
Differential Leveling
Upsampling