Wavelet-based joint estimation and encoding of depth-image-based representations for free-viewpoint rendering
Related Experiment Video
Updated: Jul 5, 2026

High-resolution, High-speed, Three-dimensional Video Imaging with Digital Fringe Projection Techniques
Published on: December 3, 2013
Matthieu Maitre1, Yoshihisa Shinagawa, Minh N Do
1Windows Experience Group, Microsoft, Redmont, WA 98052, USA. mmaitre@microsoft.com
Abstract:
We propose a wavelet-based codec for the static depth-image-based representation, which allows viewers to freely choose the viewpoint. The proposed codec jointly estimates and encodes the unknown depth map from multiple views using a novel rate-distortion (RD) optimization scheme. The rate constraint reduces the ambiguity of depth estimation by favoring piecewise-smooth depth maps. The optimization is efficiently solved by a novel dynamic programming along trees of integer wavelet coefficients. The codec encodes the image and the depth map jointly to decrease their redundancy and to provide a RD-optimized bitrate allocation between the two. The codec also offers scalability both in resolution and in quality. Experiments on real data show the effectiveness of the proposed codec.
Related Concept Videos
Depth Perception and Spatial Vision
Uniform Depth Channel Flow
Uniform Depth Channel Flow: Problem Solving
Deconvolution
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...
Relative Motion Analysis using Rotating Axes
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
Divergence Theorem in 3D Space