Multi-focus image fusion method using energy of Laplacian and a deep neural network

Multi-focus image fusion consists in the integration of the focus regions of multiple source images into a single image. At present, there are still some common problems in image fusion methods, such as block artifacts, artificial edges, halo effects, and contrast reduction. To address these problems, a novel, to the best of our knowledge, multi-focus image fusion method using energy of Laplacian and a deep neural network (DNN) is proposed in this paper. The DNN is composed of multiple denoising autoencoders and a classifier. The Laplacian energy operator can effectively extract the focus information of source images, and the trained DNN model can establish a valid mapping relationship between source images and a focus map according to the extracted focus information. First, the Laplacian energy operator is used to perform focus measurement for two source images to obtain the corresponding focus information maps. Then, the sliding window technology is used to sequentially obtain the windows from the corresponding focus information map, and all of the windows are fed back to the trained DNN model to obtain a focus map. After binary segmentation and small region filtering, a final decision map with good consistency is obtained. Finally, according to the weights provided by the final decision map, multiple source images are fused to obtain a final fusion image. Experimental results demonstrate that the proposed fusion method is superior to other existing ones in terms of subjective visual effects and objective quantitative evaluation.