Related Experiment Video
Updated: Jun 9, 2025

Conducting Concurrent Electroencephalography and Functional Near-Infrared Spectroscopy Recordings with a Flanker Task
Published on: May 24, 2020
Multi-modal EEG NEO-FFI with Trained Attention Layer (MENTAL) for mental disorder prediction
1Trinity University, San Antonio, TX, USA. glgreiner33@gmail.com.
Abstract:
Early detection and accurate diagnosis of mental disorders is difficult due to the complexity of the diagnostic process, resulting in conditions being left undiagnosed or misdiagnosed. Previous studies have demonstrated that features of Electroencephalogram (EEG) data, such as Power Spectral Density (PSD), are useful biomarkers for indicating the onset of various mental disorders. Existing models using EEG data are typically trained to distinguish between healthy and afflicted individuals, and they are unable to distinguish between individuals with different disorders. We propose MENTAL (Multi-modal EEG NEO-FFI with Trained Attention Layer) to predict an individual's mental state using both EEG and Neo-Five Factor Inventory (NEO-FFI) personality data. We include an attention layer that captures the interactions between personality traits and PSD features, and emphasizes the important PSD features. MENTAL features a Recurrent Neural Network (RNN) to model the temporal nature of EEG data. We train our model with the Two Decades Brainclinics Research Archive for Insights in Neuroscience (TDBRAIN) dataset, which consists of 1274 healthy and psychiatric individuals including over 30 different diagnoses. MENTAL is able to achieve 93.3% accuracy when trained to classify between healthy individuals and those with ADHD. When trained to identify individuals with ADHD from among 33 disorder classes, MENTAL improves accuracy from 70.5 to 81.7%. MENTAL also demonstrates over 20% improvement in predictive accuracy when trained for MDD prediction. For the multi-class classification task of three classes, MENTAL improves accuracy by 4%, and for five classes, by nearly 8%. MENTAL is the first multi-modal model that utilizes both EEG and NEO-FFI data for the task of mental disorder prediction. We are one of the first groups to utilize TDBRAIN for automated disorder classification. MENTAL is accessible and cost-effective, as EEG is more affordable than other neuroimaging methods such as MRI, and the NEO-FFI is a self- reported survey. Our model can lead to acceptance and support for individuals living with mental health challenges and improve quality of life in our society.
More Related Videos
08:45Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
Published on: October 24, 2012
10:02Event Related Potentials ERPs and other EEG Based Methods for Extracting Biomarkers of Brain Dysfunction: Examples from Pediatric Attention Deficit/Hyperactivity Disorder ADHD
Published on: March 12, 2020