Perceptual changes after learning of an arbitrary mapping between vision and hand movements

Area of Science:

• Cognitive Neuroscience
• Perception
• Human-Computer Interaction

Background:

• Understanding how the brain integrates information from different senses (multimodal integration) is crucial for explaining perception.
• Learned associations between sensory inputs can shape perceptual experiences, influencing how we interpret sensory data.

Purpose of the Study:

• To investigate the perceptual effects of learning arbitrary associations between visual stimuli (dots) and hand movement distances.
• To determine if attention modulates the integration of visual and proprioceptive information during learned associations.

Main Methods:

• Participants performed hand movements to visual targets, with varying numbers of dots correlated to movement distance during a learning phase.
• Post-training, participants judged either movement distance (Experiment 1) or dot quantity (Experiment 2) using a two-alternative forced choice method.
• Control condition involved pairing many dots with smaller movements; no significant perceptual changes were observed.

Main Results:

• Training to associate many dots with larger movements led participants to perceive movements as longer when many dots were present.
• The same training caused participants to perceive the same number of dots as fewer when larger hand movements were executed.
• No significant perceptual alterations occurred when many dots were consistently paired with smaller hand movements.

Conclusions:

• Learned correlations between body states (hand movements) and environmental features (visual stimuli) can modify perception.
• The integration of multimodal perceptual signals is influenced by learned associations and the focus of attention.
• Attention plays a critical role in determining how sensory information is combined and interpreted.