A hierarchical graph learning framework for VR-based motor imagery decoding driven by MVMD and feature optimization
Related Experiment Video
Updated: Sep 25, 2026

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment
Published on: May 10, 2024
Kaiyue Du1, Wenwen Chang1,2, Weixuan Kong1
1School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, People's Republic of China.
Abstract:
Objective. While virtual reality (VR) combined with action observation (AO) provides enriched visual guidance for motor imagery (MI), the decoding stability of MI Brain-Computer Interface (BCI) remains a challenge due to the inherent non-stationarity and low signal-to-noise ratio of Electroencephalography (EEG) signals in dynamic environments. Enhancing decoding accuracy and understanding neural representations in VR-based AO + MI tasks remain important challenges in neural engineering.Approach.This study proposes a hierarchical graph learning framework tailored for VR-based MI decoding, leveraging multivariate variational mode decomposition to decouple complex EEG signals into rhythmic components for enhanced multi-domain feature analysis, hybrid feature selection for compact representation, and functional brain network modeling based on phase locking value. Each EEG trial is represented as a sparsified graph, and a hierarchical graph convolutional network is designed to capture multi-scale spatial dependencies and high-order interactions for classification.Main results. Experimental evaluations on a lab-acquired virtual reality-based motor imagery dataset demonstrate that the proposed framework achieves competitive three-class decoding accuracy. This performance surpasses baseline models such as EEGNet, as observed under VR-based MI conditions. In addition to enhanced decoding performance, the study enables neurophysiological interpretation by characterizing VR-induced modulations in brain network organization.Significance. VR-based AO + MI paradigm is found to enhance sensorimotor connectivity and promote large-scale network integration, indicating more coordinated neural dynamics during MI tasks. These findings suggest that the proposed framework effectively improves VR-based AO + MI decoding while providing interpretable insights into neural mechanisms, supporting its potential for advanced BCI applications.
