Warp and Learn: Novel Views Generation for Vehicles and Other Objects.

Area of Science:

• Computer Vision
• Deep Learning
• Computer Graphics

Background:

• Generating novel 3D views from single images is challenging.
• Existing methods are often purely learning-based (parametric).
• Integrating prior geometric knowledge can improve synthesis quality.

Purpose of the Study:

• To develop a self-supervised, semi-parametric approach for novel view synthesis.
• To leverage a-priori geometric knowledge in a deep learning framework.
• To enable realistic image generation and shape transfer from single images.

Main Methods:

• A semi-parametric approach combining deep learning with geometric priors.
• Exploiting object symmetry and piece-wise planarity for geometric guidance.
• Training an Image Completion Network (ICN) for realistic image generation.

Main Results:

• Successful synthesis of novel views preserving high-frequency details.
• Ability to handle arbitrary 3D transformations.
• Demonstrated shape transfer capabilities to different 3D models.
• Extension to other rigid objects, including those with complex topology.

Conclusions:

• The semi-parametric method effectively blends parametric and non-parametric components.
• The approach is robust in real-world scenarios and versatile for various objects.
• Quantitative and perceptual evaluations confirm the method's efficacy.