Decoding Brain Signals from Rapid-Event EEG for Visual Analysis Using Deep Learning

Area of Science:

• Neuroscience
• Machine Learning
• Computer Vision

Background:

• Object recognition is crucial for environmental interaction, but decoding brain signals for this task is challenging.
• High noise and the complex, non-stationary nature of electroencephalogram (EEG) signals contribute to low accuracy in visual classification.
• Existing research explores temporal stimulation designs and signal complexity as factors limiting accuracy.

Purpose of the Study:

• To develop a deep learning model for decoding subjects' responses to rapid-event visual stimuli using EEG signals.
• To identify key factors contributing to low accuracy in EEG-based visual classification tasks.
• To improve the accuracy of EEG visual classification for a large number of object classes.

Main Methods:

• Proposed a multi-class, multi-channel deep learning model incorporating feature fusion (MCCFF).
• Applied the model to the largest publicly available EEG dataset for visual classification (40 object classes, 1000 images each).
• Evaluated the model's performance against contemporary state-of-the-art methods.

Main Results:

• The proposed MCCFF model achieved a classification accuracy of 33.17% for 40 object classes.
• This represents a significant improvement over the 17.6% maximum accuracy achieved by previous studies on similar datasets.
• The model effectively handles complex, non-stationary EEG signals through integrated feature fusion.

Conclusions:

• The developed deep learning model demonstrates the potential of EEG signals for advancing visual classification.
• The MCCFF approach offers a promising method for decoding complex brain activity related to visual perception.
• Results suggest future applications in developing advanced visual machine models powered by brain signals.