Convolutional neural networks decode finger movements in motor sequence learning from MEG data

Non-invasive Brain-Computer Interfaces provide accurate classification of hand movement lateralization. However, distinguishing activation patterns of individual fingers within the same hand remains challenging due to their overlapping representations in the motor cortex. Here, we validated a compact convolutional neural network for fast and reliable decoding of finger movements from non-invasive magnetoencephalographic (MEG) recordings.

We recorded healthy participants in MEG performing a serial reaction time task (SRTT), with buttons pressed by left and right index and middle fingers. We devised classifiers to identify left vs. right hand movements and among four finger movements using a recently proposed decoding approach, Linear Finite Impulse Response Convolutional Neural Network (LF-CNN). We also compared LF-CNN to existing deep learning architectures such as EEGNet, FBCSP-ShallowNet, and VGG19.

Sequence learning was reflected by a decrease in reaction times during SRTT performance. Movement laterality was decoded with an accuracy superior to 95% by all approaches, while for individual finger movement, decoding was in the 80-85% range. LF-CNN stood out for (1) its low computational time and (2) its interpretability in both spatial and spectral domains, allowing to examine neurophysiological patterns reflecting task-related motor cortex activity.

We demonstrated the feasibility of finger movement decoding with a tailored Convolutional Neural Network. The performance of our approach was comparable to complex deep learning architectures, while providing faster and interpretable outcome. This algorithmic strategy holds high potential for the investigation of the mechanisms underlying non-invasive neurophysiological recordings in cognitive neuroscience.