Patient-specific visual neglect severity estimation for stroke patients with neglect using EEG

Objective.We aim to assess the severity of spatial neglect (SN) through detailing patients' field of view (FOV) using EEG. Spatial neglect, a prevalent neurological syndrome in stroke patients, typically results from unilateral brain injuries, leading to inattention to the contralesional space. Commonly used Neglect detection methods like the Behavioral Inattention Test-conventional lack the capability to assess the full extent and severity of neglect. Although the Catherine Bergego Scale provides valuable clinical information, it does not detail the specific FOV affected in neglect patients.Approach.Building on our previously developed EEG-based brain-computer interface system, AR-guided EEG-based neglect detection, assessment, and rehabilitation system (AREEN), we aim to map neglect severity across a patient's FOV. We have demonstrated that AREEN can assess neglect severity in a patient-agnostic manner. However, its effectiveness in patient-specific scenarios, which is crucial for creating a generalizable plug-and-play system, remains unexplored. This paper introduces a novel EEG-based combined spatio-temporal network (ESTNet) that processes both time and frequency domain data to capture essential frequency band information associated with SN. We also propose a FOV correction system using Bayesian fusion, leveraging AREEN's recorded response times for enhanced accuracy by addressing noisy labels within the dataset.Main results.Extensive testing of ESTNet on our proprietary dataset has demonstrated its superiority over benchmark methods, achieving 79.62% accuracy, 76.71% sensitivity, and 86.36% specificity. Additionally, we provide saliency maps to enhance model explainability and establish clinical correlations.Significance.These findings underscore ESTNet's potential combined with Bayesian fusion-based FOV correction as an effective tool for generalized neglect assessment in clinical settings.