Differing Roles of the Face and Voice in Early Human Communication: Roots of Language in Multimodal Expression.

Area of Science:

• Developmental Psychology
• Linguistics
• Communication Studies

Background:

• The origins of human language are deeply rooted in early communication systems.
• Infant vocalizations and facial expressions are critical components of pre-linguistic communication.
• Understanding the distinct roles of vocal and facial cues in infancy is key to tracing language evolution.

Purpose of the Study:

• To investigate the transmission of affect and vocal type through infant protophones and facial expressions.
• To determine the reliability of audio-only and video-only cues in conveying infant communicative signals.
• To explore the early emergence of functional specialization between facial and vocal communication in infants.

Main Methods:

• Analysis of infant vocalizations (protophones) and co-occurring facial expressions.
• Coder agreement studies using audio-only, video-only, and combined audio-visual stimuli.
• Assessment of information transmission for affect (positive, negative, neutral) and vocal type.

Main Results:

• Infant affect was most reliably transmitted by facial expressions (video-only).
• Vocal type was most reliably transmitted by vocalizations (audio-only).
• Voice alone effectively conveyed negative affect, suggesting a distress- signaling function, while faces alone did not reliably indicate protophone categories.

Conclusions:

• A partial decoupling of communicative roles between face and voice emerges in early infancy.
• Infant communication flexibly integrates audio and visual information, mirroring mature language systems.
• Facial cues primarily signal affect, while vocal cues signal vocalization type and distress in early development.