Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

MsGCN: a multi-stream graph convolutional network for multiband PLV graph fusion in EEG-based biometric identification.

Frontiers in computational neuroscience·2026

Same author

Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations.

Nature communications·2026

Same author

Dual controllability de-differentiation of functional brain networks in major depressive disorder: Insights from large-scale neuroimaging and transcriptomic integration.

Journal of affective disorders·2026

Same author

Functional connectivity-based classification and subtyping of major depression for precision mental health: An ensemble graph neural network approach.

PLOS digital health·2026

Same author

Accelerometric decoding of upper extremity movement intention in children with and without cerebral palsy: Complementary value of mechanomyography.

Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology·2026

Same author

Enhancing Bone Conduction Sensor Signals via Self-Supervised Acoustic Priors and Key-Value Memory.

Sensors (Basel, Switzerland)·2026

Search research articles

Related Experiment Video

Updated: Mar 28, 2026

Assessment and Communication for People with Disorders of Consciousness

Assessment and Communication for People with Disorders of Consciousness

Published on: August 1, 2017

An Auditory-Tactile Visual Saccade-Independent P300 Brain-Computer Interface.

Erwei Yin^1,2, Timothy Zeyl³, Rami Saab⁴

¹1 College of Mechatronic Engineering and Automation, National University of Defense Technology, Changsha, Hunan 410073, P. R. China.

International Journal of Neural Systems

|December 19, 2015

Summary

This study introduces a novel bimodal brain-computer interface (BCI) using auditory and tactile stimuli to enhance performance for individuals unable to use eye-movement-based systems. The new approach significantly improves the information transfer rate for saccade-independent P300 BCIs.

Keywords:

Brain–computer interface P300 event-related potentials auditory bimodal stimuli tactile

More Related Videos

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

Related Experiment Videos

Last Updated: Mar 28, 2026

Assessment and Communication for People with Disorders of Consciousness

Assessment and Communication for People with Disorders of Consciousness

Published on: August 1, 2017

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

Area of Science:

Neuroscience
Biomedical Engineering
Rehabilitation Technology

Background:

Traditional P300 event-related potential (ERP)-based brain-computer interfaces (BCIs) often rely on gaze shifts, limiting their use for individuals with impaired voluntary eye movement.
Existing visual saccade-independent P300 BCIs demonstrate suboptimal performance, necessitating advancements for broader applicability.

Purpose of the Study:

To develop and evaluate a novel bimodal P300 BCI system that integrates auditory and tactile stimuli to improve performance in a vision-independent manner.
To enhance the usability and effectiveness of BCIs for individuals with severe motor impairments, including those who have lost voluntary eye movement.

Main Methods:

A direction-congruent bimodal paradigm was implemented, presenting simultaneous auditory and tactile stimuli from the same direction.
The system was vision-independent, requiring no visual interaction from the user.
Individual participant data, including channel selection and trial numbers, were optimized to maximize online performance.

Main Results:

The bimodal P300 BCI approach demonstrated a significant improvement in the average online information transfer rate (ITR) compared to unimodal auditory or tactile stimuli alone.
Specifically, the bimodal approach yielded a 45.43% and 51.05% increase in ITR over auditory-only and tactile-only approaches, respectively.
The average online ITR for the bimodal system reached 10.77 bits/min, including inter-selection break times.

Conclusions:

The proposed bimodal P300 BCI, utilizing simultaneous auditory and tactile stimuli, offers a promising solution for practical, vision-independent brain-computer interfaces.
This approach significantly enhances BCI performance for users unable to utilize gaze shift-dependent systems, expanding accessibility for individuals with severe motor disabilities.