Total generalized variation regularization for multi-modal electron tomography

In multi-modal electron tomography, tilt series of several signals such as X-ray spectra, electron energy-loss spectra, annular dark-field, or bright-field data are acquired at the same time in a transmission electron microscope and subsequently reconstructed in three dimensions. However, the acquired data are often incomplete and suffer from noise, and generally each signal is reconstructed independently of all other signals, not taking advantage of correlation between different datasets. This severely limits both the resolution and validity of the reconstructed images. In this paper, we show how image quality in multi-modal electron tomography can be greatly improved by employing variational modeling and multi-channel regularization techniques. To achieve this aim, we employ a coupled Total Generalized Variation (TGV) regularization that exploits correlation between different channels. In contrast to other regularization methods, coupled TGV regularization allows to reconstruct both hard transitions and gradual changes inside each sample, and links different channels at the level of first and higher order derivatives. This favors similar interface positions for all reconstructions, thereby improving the image quality for all data, in particular, for 3D elemental maps. We demonstrate the joint multi-channel TGV reconstruction on tomographic energy-dispersive X-ray spectroscopy (EDXS) and high-angle annular dark field (HAADF) data, but the reconstruction method is generally applicable to all types of signals used in electron tomography, as well as all other types of projection-based tomographies.