SemSTNet: Medical EEG Semantic Metric Learning With Class Prototypes Generated by Pretrained Language Model

Area of Science:

• Neuroscience
• Artificial Intelligence
• Biomedical Engineering

Background:

• Electroencephalography (EEG) feature learning is vital for brain-machine interfaces and medical diagnostics.
• Current deep learning models often lack efficiency and fail to capture semantic relationships between EEG classes.
• Overly complex models with numerous parameters hinder practical applications.

Purpose of the Study:

• To develop a novel, lightweight framework (SemSTNet) for efficient EEG analysis.
• To address the limitations of existing deep learning models in capturing inter-class semantic relationships.
• To reduce model complexity and parameter count while maintaining high performance.

Main Methods:

• Designed an efficient, lightweight convolutional architecture for decoupled spatial and temporal feature extraction.
• Introduced a semantic metric learning paradigm using class prototypes from a pretrained language model.
• Prototypes are extracted offline, reducing computational load during training and deployment.

Main Results:

• SemSTNet achieved superior performance on epilepsy classification and sleep staging tasks compared to state-of-the-art methods.
• The proposed model has significantly fewer parameters (23K) compared to common Transformer-based models.
• Demonstrated effectiveness and efficiency in EEG analysis.

Conclusions:

• Integrating semantic knowledge with a lightweight architecture offers a highly effective and efficient solution for EEG analysis.
• SemSTNet provides a promising alternative for developing advanced brain-machine interfaces and diagnostic tools.
• The framework's reduced complexity makes it suitable for real-world applications.