A Platform for Virtual Reality Task Design with Intracranial Electrodes

Area of Science:

• Neuroscience
• Biotechnology
• Computer Science

Background:

• Human intracranial electrode research is limited by clinical settings.
• Virtual reality (VR) offers precise control over stimuli, transcending traditional research environments.
• Integrating VR with neural recording (electrocorticography/stereo-electroencephalography) requires robust systems engineering.

Purpose of the Study:

• To develop a custom API bridging VR development engines and neural recording/stimulation platforms.
• To demonstrate the API's functionality and efficiency through a closed-loop brain-computer interface (BCI) task.
• To validate the system's utility, safety, and efficacy for human research deployment.

Main Methods:

• Developed a custom API to integrate Unity (VR engine) with Tucker Davis Technologies (TDT) Synapse software.
• Engineered a closed-loop brain-computer interface (BCI) task within a VR environment.
• Utilized filtered neural signals to control virtual object movement and triggered neural stimulation based on virtual object dynamics.

Main Results:

• Successfully created and demonstrated a functional API for VR-integrated neural research.
• Validated the closed-loop VR-BCI task, showing effective control and stimulation.
• Confirmed the system's utility, safety, and readiness for human subject deployment.

Conclusions:

• The developed API provides a powerful platform for advanced in-patient human electroencephalography (ECOG) and stereo-electroencephalography (sEEG) research.
• This system enables novel BCI paradigms with precise control over sensory stimuli and neural feedback.
• The successful implementation paves the way for more sophisticated human neuroscience investigations using immersive VR technology.