Integrated Analysis of EEG and fMRI Using Sparsity of Spatial Maps

Integration of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) is an open problem, which has motivated many researches. The most important challenge in EEG-fMRI integration is the unknown relationship between these two modalities. In this paper, we extract the same features (spatial map of neural activity) from both modality. Therefore, the proposed integration method does not need any assumption about the relationship of EEG and fMRI. We present a source localization method from scalp EEG signal using jointly fMRI analysis results as prior spatial information and source separation for providing temporal courses of sources of interest. The performance of the proposed method is evaluated quantitatively along with multiple sparse priors method and sparse Bayesian learning with the fMRI results as prior information. Localization bias and source distribution index are used to measure the performance of different localization approaches with or without a variety of fMRI-EEG mismatches on simulated realistic data. The method is also applied to experimental data of face perception of 16 subjects. Simulation results show that the proposed method is significantly stable against the noise with low localization bias. Although the existence of an extra region in the fMRI data enlarges localization bias, the proposed method outperforms the other methods. Conversely, a missed region in the fMRI data does not affect the localization bias of the common sources in the EEG-fMRI data. Results on experimental data are congruent with previous studies and produce clusters in the fusiform and occipital face areas (FFA and OFA, respectively). Moreover, it shows high stability in source localization against variations in different subjects.