Cross-task cognitive workload recognition using a dynamic residual network with attention mechanism based on neurophysiological signals

Evaluation of human cognitive workload (CW) helps improve the user experience of human-centered systems. To provide a continuous estimation of the CW, we built a CW recognizer that maps human electroencephalograms (EEGs) to discrete CW levels with deep learning tools. However, the EEG distribution varies when humans perform different cognitive tasks. There is thus a question on the capacity for generalizing the CW recognizer across tasks. In this study, we examined the CW's performance when it was trained and tested on two EEG databases corresponding to different human-machine tasks.

A novel deep neural network-based EEG recognizer, dynamic residual network with attention mechanism (DRNA-Net), is proposed in the present study. By taking advantage of recurrent networks, the DRNA-Net further incorporates a self-attention mechanism in discovering robust EEG patterns across different cognitive tasks.

We designed an experiment that applied a multidimensional N-back task to induce the CW that consists of visual and auditory memory tasks. We validated the cross-task generalization capability of the DRNA-Net based on the EEG features extracted from the N-back task and a public database. The results show that the DRNA-Net achieves classification accuracy and Macro-F1 values are 0.6055 and 0.6067, respectively.

The performance of the DRNA-Net indicates that it has a certain ability of cross-task cognitive workload classification, which outperforms several shallow learners and deep convolutional neural networks under various conditions of the feature subsets.