Pseudo-online framework for BCI evaluation: a MOABB perspective using various MI and SSVEP datasets

Objective. BCI (Brain-Computer Interfaces) operate in three modes:online,offline, andpseudo-online. Inonlinemode, real-time EEG data is constantly analyzed. Inofflinemode, the signal is acquired and processed afterwards. Thepseudo-onlinemode processes collected data as if they were received in real-time. The main difference is that theofflinemode often analyzes the whole data, while theonlineandpseudo-onlinemodes only analyze data in short time windows.Offlineprocessing tends to be more accurate, whileonlineanalysis is better for therapeutic applications.Pseudo-onlineimplementation approximatesonlineprocessing without real-time constraints. Many BCI studies beingofflineintroduce biases compared to real-life scenarios, impacting classification algorithm performance.Approach. The objective of this research paper is therefore to extend the current MOABB framework, operating inofflinemode, so as to allow a comparison of different algorithms in apseudo-onlinesetting with the use of a technology based on overlapping sliding windows. To do this will require the introduction of a idle state event in the dataset that takes into account all different possibilities that are not task thinking. To validate the performance of the algorithms we will use the normalized Matthews correlation coefficient and the information transfer rate.Main results. We analyzed the state-of-the-art algorithms of the last 15 years over several motor imagery and steady state visually evoked potential multi-subjects datasets, showing the differences between the two approaches from a statistical point of view.Significance. The ability to analyze the performance of different algorithms inofflineandpseudo-onlinemodes will allow the BCI community to obtain more accurate and comprehensive reports regarding the performance of classification algorithms.