A 36-Class Bimodal ERP Brain-Computer Interface Using Location-Congruent Auditory-Tactile Stimuli.

Area of Science:

• Neuroscience
• Biomedical Engineering
• Human-Computer Interaction

Background:

• Traditional event-related potential brain-computer interface (ERP-BCI) systems rely on visual stimuli, limiting their use for visually impaired individuals.
• Existing gaze-independent ERP-BCIs often exhibit suboptimal performance, necessitating the development of improved techniques.
• There is a critical need for non-visual BCI solutions to enhance accessibility and usability.

Purpose of the Study:

• To develop and evaluate a novel 36-class bimodal ERP-BCI system integrating tactile and auditory stimuli.
• To assess the performance of this bimodal system compared to unimodal auditory and tactile approaches.
• To demonstrate the potential utility of a gaze-independent BCI for real-world applications.

Main Methods:

• A bimodal ERP-BCI system was created using virtual-direction audio files (via HRTF) and location-congruent electro-tactile stimuli on the abdomen and waist.
• A Bayesian linear discriminant analysis (BLDA) classifier was trained using eight selected EEG channels.
• The optimal number of trials for online target selection was determined.

Main Results:

• The bimodal ERP-BCI achieved an average online information transfer rate (ITR) of 11.66 bit/min.
• This represents a significant performance improvement of 35.11% over the auditory-only approach (8.63 bit/min) and 36.69% over the tactile-only approach (8.53 bit/min).
• The bimodal system demonstrated superior performance compared to each individual unimodal system.

Conclusions:

• The developed bimodal ERP-BCI system effectively integrates tactile and auditory stimuli for enhanced performance.
• This approach offers a promising solution for gaze-independent brain-computer interfaces, particularly for individuals with visual impairments.
• The findings suggest significant potential for the bimodal system in future real-world BCI applications.