Reconstruction of perspective shifts and refocusing of a three-dimensional scene from a multi-focus image stack

The convergence of optical imaging acquisition and image processing algorithms is a fast-evolving interdisciplinary research field focused on the reconstruction of images with novel features of interest. We propose a method for post-capture perspective shift reconstruction (in the x, y, and z directions) of a three-dimensional scene as well as refocusing with apertures of arbitrary shapes and sizes from an optimal multi-focus image stack. The approach is based on the reorganization of the acquired visual information considering a depth-variant point-spread function, which allows it to be applied to strongly defocused multi-focus image stacks. Our method is performed without estimating the depth map or segmenting the in-focus regions. A conventional camera combined with an electrically tunable lens is used for image acquisition and does not require scale transformation or registration between the acquired images. Experimental results for both real and synthetic data images are provided and compared to state-of-the-art schemes.