The Effects of Visual-Olfactory Interactions With Moving Particles on EEG-Based Emotional Classification in AR...

Area of Science:

• Neuroscience
• Psychology
• Computer Science

Background:

• Cross-modal perception integrates sensory information, influencing emotional experiences.
• Research on visual-olfactory interactions and their emotional impact is limited.

Purpose of the Study:

• To investigate the effects of combined visual and olfactory stimuli on emotional responses.
• To analyze how visual cues modulate electroencephalography (EEG) signals during multisensory emotional processing.

Main Methods:

• Experiments utilized five visual stimulation methods paired with olfactory stimuli.
• Emotional responses were assessed using surveys and EEG signal analysis.
• Visual stimuli varied in color and movement direction of augmented particles.

Main Results:

• Visual-olfactory interactions significantly affected emotional state classification accuracy.
• Backward-moving particles with matching colors (M4) yielded classification accuracy comparable to unimodal olfactory conditions (M1).
• Other visual stimuli generally led to confusion in emotional response classification, and valence ratings did not consistently align with EEG results.

Conclusions:

• Visual stimuli introduce complexities into neural signals, modulating emotional responses during multisensory integration.
• Findings suggest potential applications for visual-olfactory interactions in augmented reality (AR) for mood modulation and stress relief.
• This research highlights the importance of multisensory integration in emotion analysis and affective computing.