Error-related potentials during multitasking involving sensorimotor control: an ERP and offline decoding study for brain-computer interface

Humans achieve efficient behaviors by perceiving and responding to errors. Error-related potentials (ErrPs) are electrophysiological responses that occur upon perceiving errors. Leveraging ErrPs to improve the accuracy of brain-computer interfaces (BCIs), utilizing the brain's natural error-detection processes to enhance system performance, has been proposed. However, the influence of external and contextual factors on the detectability of ErrPs remains poorly understood, especially in multitasking scenarios involving both BCI operations and sensorimotor control. Herein, we hypothesized that the difficulty in sensorimotor control would lead to the dispersion of neural resources in multitasking, resulting in a reduction in ErrP features. To examine this, we conducted an experiment in which participants were instructed to keep a ball within a designated area on a board, while simultaneously attempting to control a cursor on a display through motor imagery. The BCI provided error feedback with a random probability of 30%. Three scenarios-without a ball (single-task), lightweight ball (easy-task), and heavyweight ball (hard-task)-were used for the characterization of ErrPs based on the difficulty of sensorimotor control. In addition, to examine the impact of multitasking on ErrP-BCI performance, we analyzed single-trial classification accuracy offline. Contrary to our hypothesis, varying the difficulty of sensorimotor control did not result in significant changes in ErrP features. However, multitasking significantly affected ErrP classification accuracy. Post-hoc analyses revealed that the classifier trained on single-task ErrPs exhibited reduced accuracy under hard-task scenarios. To our knowledge, this study is the first to investigate how ErrPs are modulated in a multitasking environment involving both sensorimotor control and BCI operation in an offline framework. Although the ErrP features remained unchanged, the observed variation in accuracy suggests the need to design classifiers that account for task load even before implementing a real-time ErrP-based BCI.