Shared Neural Codes for Emotion Recognition in Emoji and Human Faces.

Area of Science:

• Neuroscience
• Cognitive Science
• Human-Computer Interaction

Background:

• Facial expressions are vital for human communication.
• Emojis are digital substitutes for nonverbal cues like facial expressions.
• Neural processing of emoji expressions compared to real faces is not well understood.

Purpose of the Study:

• To investigate if the brain processes emoji facial expressions using similar neural mechanisms as real faces.
• To examine the neural dynamics of emotional expression processing in both real and emoji faces.

Main Methods:

• Used electroencephalography (EEG) with multivariate pattern analysis (MVPA).
• Conducted two experiments with participants recognizing emotions in real faces and emojis.
• Employed time-resolved multivariate classification and spatio-temporal searchlight analyses.

Main Results:

• Successfully decoded emotional expressions from both real and emoji faces.
• Identified early neural effects (145-160ms) in posterior-occipital and parietal regions.
• Found significant cross-classification between real and emoji faces, indicating comparable neural responses.

Conclusions:

• The brain utilizes overlapping spatio-temporal codes for processing naturalistic and symbolic facial expressions.
• Emoji faces elicit neural responses comparable to real faces, suggesting shared processing mechanisms.
• Provides insights into the neural coding of social signals and the overlap between natural and artificial emotional expressions.