Facial Affect Recognition in Immersive Virtual Reality: Where is the Participant Looking?

Area of Science:

• Cognitive Psychology
• Neuroscience
• Human-Computer Interaction

Background:

• Facial expression recognition is crucial for social interaction.
• Traditional eye-tracking studies with static images have ecological validity limitations.
• Virtual reality (VR) offers dynamic, immersive environments for studying face perception.

Purpose of the Study:

• To investigate if VR immersion influences visual scanning of dynamic virtual faces during emotion decoding.
• To validate a VR-based methodology for studying facial emotion recognition.
• To lay groundwork for researching emotion recognition deficits in neuropsychiatric disorders.

Main Methods:

• An experiment was conducted with 74 healthy participants.
• Participants' visual scanning patterns of dynamic virtual faces were recorded within a VR environment.
• The study focused on how immersion affects gaze behavior during emotion decoding.

Main Results:

• The results align with previous eye-tracking studies using static images.
• The VR system's functionality for studying visual scanning was confirmed.
• The study established a reliable method for observing dynamic face processing in VR.

Conclusions:

• VR immersion does not significantly alter visual scanning patterns compared to traditional methods.
• The validated VR approach is suitable for future research on emotion recognition.
• This methodology can be applied to investigate visual attention deficits in neuropsychiatric conditions.