Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Emotion Recognition Using Multi-View EEG-fNIRS and Cross-Attention Feature Fusion.

Biosensors·2026
Same author

Development and application of NanoLuc-based LIPS assay for antibody detection of orthohantavirus infections and vaccine responses.

International journal of biological macromolecules·2026
Same author

EEG-fNIRS Cross-Subject Emotion Recognition Based on Attention Graph Isomorphism Network and Contrastive Learning.

Brain sciences·2026
Same author

Single-cell transcriptomic analyses of HSV-1 reactivation from latently infected tree shrew and mouse trigeminal ganglia reveal differing molecular and cellular processes.

Virologica Sinica·2026
Same author

Risk factors and analysis of retinopathy of prematurity in monochorionic diamniotic twins.

Journal of perinatal medicine·2026
Same author

Risk factors for hemodynamically significant patent ductus arteriosus and ibuprofen treatment failure in premature twins: a retrospective case-control study.

Frontiers in cardiovascular medicine·2026

Related Experiment Video

Updated: Aug 25, 2025

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.7K

A novel brain-computer interface based on audio-assisted visual evoked EEG and spatial-temporal attention CNN.

Guijun Chen1, Xueying Zhang1, Jing Zhang1

  • 1College of Information and Computer, Taiyuan University of Technology, Taiyuan, China.

Frontiers in Neurorobotics
|October 17, 2022
PubMed
Summary

This study introduces an audio-assisted visual brain-computer interface (BCI) speller that improves efficiency for disabled users. A novel deep learning model achieved high accuracy in decoding single-trial event-related potentials (ERPs).

Keywords:
audio-assisted visual evoked EEGbrain-computer interfaceconvolutional neural networkspace division multiple accessspatial-temporal attention

More Related Videos

Assessment and Communication for People with Disorders of Consciousness
07:37

Assessment and Communication for People with Disorders of Consciousness

Published on: August 1, 2017

9.2K
Extracting Visual Evoked Potentials from EEG Data Recorded During fMRI-guided Transcranial Magnetic Stimulation
09:36

Extracting Visual Evoked Potentials from EEG Data Recorded During fMRI-guided Transcranial Magnetic Stimulation

Published on: May 12, 2014

13.9K

Related Experiment Videos

Last Updated: Aug 25, 2025

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
08:45

Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example

Published on: October 24, 2012

14.7K
Assessment and Communication for People with Disorders of Consciousness
07:37

Assessment and Communication for People with Disorders of Consciousness

Published on: August 1, 2017

9.2K
Extracting Visual Evoked Potentials from EEG Data Recorded During fMRI-guided Transcranial Magnetic Stimulation
09:36

Extracting Visual Evoked Potentials from EEG Data Recorded During fMRI-guided Transcranial Magnetic Stimulation

Published on: May 12, 2014

13.9K

Area of Science:

  • Neuroscience and Biomedical Engineering
  • Human-Computer Interaction

Background:

  • Brain-computer interfaces (BCIs) offer transformative communication for individuals with disabilities.
  • Existing BCIs often face challenges in efficiency and accuracy for real-time applications.
  • Decoding single-trial event-related potentials (ERPs) is crucial for improving BCI performance.

Purpose of the Study:

  • To explore the feasibility of a novel audio-assisted visual BCI speller.
  • To develop and evaluate a deep learning-based strategy for single-trial ERP decoding.
  • To enhance the efficiency and accuracy of BCI spellers.

Main Methods:

  • A two-stage BCI speller was designed, combining motion-onset visual evoked potentials (mVEPs) and audio-assisted ERPs.
  • A spatial-temporal attention-based convolutional neural network (STA-CNN) was proposed for single-trial ERP recognition.
  • EEG data from 10 subjects were recorded and analyzed to evaluate the system's performance.

Main Results:

  • The STA-CNN model achieved average classification accuracies of 59.6% and 77.7% for the first and second stages, respectively.
  • Performance metrics were significantly higher than comparison methods (p < 0.05).
  • The STA-CNN effectively extracted interpretable spatiotemporal EEG features, validated by attention weight analysis.

Conclusions:

  • The proposed two-stage audio-assisted visual BCI paradigm demonstrates significant potential for BCI speller applications.
  • The STA-CNN model offers an effective approach for decoding complex EEG signals in real-time.
  • This research contributes to advancing BCI technology for improved user interaction and accessibility.