Brain Activation During Visually Guided Finger Movements

Area of Science:

• Neuroscience
• Human-Computer Interaction
• Virtual Reality

Background:

• Computer interaction relies on visual feedback, with current methods using abstract cursors or virtual hands of varying realism.
• The impact of different visual feedback types on brain activity during virtual reality interactions is not well understood.

Purpose of the Study:

• To investigate how different visual feedback types (abstract cursor, point light, shadow hand, realistic virtual hand) affect brain activity during visually guided finger movements in virtual reality.
• To compare neural responses during active movement versus observation across feedback conditions.

Main Methods:

• 19 healthy adults performed and observed index finger movements in VR with four feedback types: cursor (CU), point light (PL), shadow hand (SH), and virtual hand (VH).
• Data collected included finger movements (data glove), eye-tracking, and brain activity (fMRI).

Main Results:

• Both action and observation conditions showed increased fMRI signals in the occipitotemporal cortex compared to baseline.
• Action conditions additionally activated motor, somatosensory, parietal, and cerebellar regions.
• Hand-based feedback (SH, VH) resulted in higher activations in visual and occipitotemporal areas compared to CU and PL feedback for both conditions.

Conclusions:

• Visually guided finger movements with realistic human hand feedback recruit a broader network of cortical regions compared to abstract or incomplete visual representations.
• These findings have implications for optimizing the design of virtual reality systems for research, applications, and training involving human body representations.