Enhancing the performance of SSVEP-based BCIs by combining task-related component analysis and deep neural network

Steady-State Visually Evoked Potential (SSVEP) signals can be decoded by either a traditional machine learning algorithm or a deep learning network. Combining the two methods is expected to enhance the performance of an SSVEP-based brain-computer interface (BCI) by exploiting their advantages. However, an efficient strategy for integrating the two methods has not yet been established. To address this issue, we propose a classification framework named eTRCA + sbCNN that combines an ensemble task-related component analysis (eTRCA) algorithm and a sub-band convolutional neural network (sbCNN) for recognizing the frequency of SSVEP signals. The two models are first trained separately, then their classification score vectors are added together, and finally the frequency corresponding to the maximal summed score is decided as the frequency of SSVEP signals. The proposed framework can effectively exploit the complementarity between the two kinds of feature signals and significantly improve the classification performance of SSVEP-based BCIs. The performance of the proposed method is validated on two SSVEP BCI datasets and compared with that of eTRCA, sbCNN and other state-of-the-art models. Experimental results indicate that the proposed method significantly outperform the compared algorithms, and thus helps to promote the practical application of SSVEP- BCI systems.