Adults interpret iconicity in speech and gesture via the same modality-independent process

Area of Science:

• Cognitive Science
• Linguistics
• Psychology

Background:

• Iconicity, the resemblance between a signal's form and meaning, is a fundamental aspect of human communication.
• Understanding how iconicity is processed across different sensory modalities is crucial for cognitive and linguistic theories.

Purpose of the Study:

• To investigate whether adults interpret iconicity in speech and gesture through a modality-independent cognitive mechanism.
• To determine if performance in iconic speech tasks correlates with performance in iconic gesture tasks.

Main Methods:

• Two studies (N=40 and N=348) involving verb-action matching tasks.
• Participants matched spoken verbs and co-speech gestures, manipulated for iconic rate, to corresponding actions.
• Correlation analysis was used to assess the relationship between speech and gesture iconicity interpretation.

Main Results:

• Participants successfully used iconic cues in both speech and gesture tasks.
• A significant positive correlation was found between performance in the speech and gesture iconicity tasks.
• This correlation persisted even when controlling for verbal working memory capacity.

Conclusions:

• Adults appear to utilize a modality-independent cognitive mechanism for interpreting iconicity.
• This mechanism integrates auditory information from speech and visual information from gestures.
• Findings support a unified account of iconicity processing across sensory modalities.