Virtual Reality Platform for Systematic Investigation of Multisensory Integration and Training of Closed-Loop...

Area of Science:

• Neuroscience
• Human-Computer Interaction
• Robotics

Background:

• Multisensory integration is crucial for nervous system function and has translational applications in neural prosthetics.
• Understanding upper limb multisensory integration is key for developing advanced prosthetic control systems.

Purpose of the Study:

• To describe a virtual reality platform for studying neural mechanisms of multisensory integration in the upper limb.
• To assess the platform's utility for training robust neural prosthetic control.

Main Methods:

• Developed a versatile virtual reality platform involving multiple computers and programs.
• Enabled selection of avatar arms and modification of visual properties (e.g., blurring).
• Tested the system with non-human primates performing reaching tasks, altering visual and tactile feedback reliability.

Main Results:

• Observed significant differences in movement endpoint distributions.
• Variations in results were noted between individual animals and across different visual feedback conditions and targets.
• The platform demonstrated reliable control over sensory feedback manipulation.

Conclusions:

• The virtual reality platform provides a controlled environment for studying multisensory integration.
• The system shows potential for developing and training neural prosthetic control systems.
• Findings highlight the impact of altered sensory feedback on motor control in primates.