Affordance Compatibility Effect for Word Learning in Virtual Reality

Area of Science:

• Cognitive Science
• Neuroscience
• Linguistics

Background:

• Sensorimotor interaction is believed to facilitate language acquisition and ground conceptual representations.
• Empirical evidence for the role of sensorimotor interaction in early embodied word learning is limited.
• Investigating how sensorimotor interaction influences linguistic representations is crucial for validating embodied language theories.

Purpose of the Study:

• To provide empirical support for embodied language theories by demonstrating how sensorimotor interaction shapes learned linguistic representations.
• To investigate the role of physical interaction in the formation of word-object associations.

Main Methods:

• A gamified virtual reality experiment was designed for participants to learn novel object names through physical manipulation (grasping and manipulating objects with specific hands).
• Participants completed a word-color matching task to assess their learned word-object associations.
• Two follow-up experiments examined the effects of observation and hand- versus spatial compatibility.

Main Results:

• Participants exhibited faster response times in a word-color match task when the response hand was compatible with the hand used to interact with the object (affordance compatibility effect).
• Observing virtual hands interact with objects was sufficient to induce a smaller affordance compatibility effect.
• The compatibility effect was primarily driven by hand compatibility, not spatial location.

Conclusions:

• The findings support theories that ground word representations in sensorimotor experiences.
• The study highlights the significance of embodied cognition in language processing.
• Immersive virtual reality experiments offer a promising avenue for exploring the sensorimotor underpinnings of higher cognitive functions.