Simultaneous neural and movement recording in large-scale immersive virtual environments.

Area of Science:

• Neuroscience
• Virtual Reality Technology
• Biomedical Engineering

Background:

• Understanding brain-behavior relationships is crucial for diagnosing and treating neurological disorders.
• Current methods for studying neural activity during movement are limited in scope and precision.
• Virtual reality (VR) offers potential for controlled, dynamic stimulus presentation.

Purpose of the Study:

• To develop and present a novel system integrating immersive 3D multi-modal VR with electroencephalography (EEG).
• To enable precise, real-time monitoring of brain activity during active movement within a virtual environment.
• To advance the study of brain-behavioral relations and facilitate neurological assessment and rehabilitation.

Main Methods:

• Integration of a state-of-the-art, fully immersive, 3D, multi-modal VR system (visual, auditory, haptic).
• Simultaneous electroencephalographic (EEG) recordings during subject movement within a 20x20 ft² space.
• Achieved end-to-end latency of approximately 40 ms and spatial precision of millimeters.
• Temporal alignment of VR stimuli with neural recordings accurate to within approximately 1 ms.

Main Results:

• Demonstrated a highly synchronized system for VR-based neural monitoring.
• Achieved low latency (approx. 40 ms) and high spatial precision (millimeters) in the VR environment.
• Established millisecond-level temporal accuracy between neural recordings and VR events.

Conclusions:

• The combined VR-EEG system provides an unprecedented tool for investigating brain-behavioral dynamics.
• This technology opens new avenues for assessing and rehabilitating individuals with motor and other neurological disorders.
• The system's precision and immersive nature enhance the study of neural processes during complex behaviors.