Related Experiment Video
Updated: Jul 2, 2025
08:45
Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
Published on: October 24, 2012
14.7K
Customizing the human-avatar mapping based on EEG error related potentials
Fumiaki Iwane1,2,3, Thibault Porssut4,5,6, Olaf Blanke5,7
1Learning Algorithms and Systems Laboratory (LASA), École Polytechnique Féderale de Lausanne (EPFL), 1015 Lausanne, Switzerland.
Journal of Neural Engineering
|February 22, 2024
Summary
This study introduces a brain-computer interface (BCI) to detect and correct virtual reality (VR) embodiment disruptions in real-time. The novel BCI system enhances user experience by adjusting human-avatar mapping without interruption.
Area of Science:
- Neuroscience
- Virtual Reality
- Human-Computer Interaction
Background:
- Maintaining a reliable human-avatar mapping is crucial for immersive virtual reality (VR) experiences.
- Breaks in embodiment (BiE), such as loss of agency or body ownership, disrupt user experience.
- Current methods for detecting BiE rely on subjective user reports, limiting real-time intervention.
Purpose of the Study:
- To develop and validate a novel brain-computer interface (BCI) for real-time implicit detection of BiE in VR.
- To enable seamless adjustment of human-avatar mapping to prevent BiE.
- To create a 'Plug-and-Play' non-invasive BCI solution for VR applications.
Main Methods:
- A novel BCI approach was developed to monitor users' brain oscillatory activity (EEG).
- EEG data was collected from 37 participants performing reaching movements with distorted avatar feedback.
- A BCI-reinforcement learning (RL) closed-loop system was used to customize human-avatar mapping.
Main Results:
- The BCI approach accurately predicted BiE across varying magnitudes of erroneous interaction.
- The closed-loop RL system successfully customized mapping to prevent BiE.
- A non-personalized BCI decoder demonstrated generalization to new users, enabling 'Plug-and-Play' functionality.
Conclusions:
- The developed VR-BCI system effectively detects BiE in real-time.
- Seamless correction of human-avatar mapping is achievable without personalized decoders or user reports.
- This technology promises to enhance avatar-based interaction and immersive experiences in VR.
