Related Experiment Video
Updated: Jun 16, 2026
05:36
Central and Divided Visual Field Presentation of Emotional Images to Measure Hemispheric Differences in Motivated Attention
Published on: November 16, 2017
Sensory modality affects emotional dimension perception and frontoparietal brain responses
Youngju Lee1, Yongseong Lee1, Yujeong Kim1
1Cognitive Science Research Group, Korea Brain Research Institute, Daegu, Republic of Korea.
Summary
Sensory modality significantly impacts how we perceive emotions. Audiovisual cues enhance frontoparietal brain activity and arousal ratings, influencing emotional evaluation.
Area of Science:
- Neuroscience
- Cognitive Psychology
- Social Psychology
Background:
- Emotion perception is crucial for social interaction.
- It involves processing visual, auditory, or combined stimuli.
- How different sensory modalities influence emotion evaluation remains unclear.
Purpose of the Study:
- To investigate the effects of audio-only (AO), video-only (VO), and audiovisual (AV) stimuli on emotion perception.
- To examine frontoparietal brain responses using functional near-infrared spectroscopy (fNIRS).
- To explore the relationship between brain activity and behavioral evaluations of emotional valence and arousal.
Main Methods:
- Participants performed an emotion perception task with seven emotion categories.
- Stimuli were presented in AO, VO, and AV conditions.
- fNIRS measured brain activity (oxygenated hemoglobin - HbO) in the frontoparietal network.
Main Results:
- Behavioral evaluations of emotional valence and arousal differed significantly across AO, VO, and AV conditions.
- AV stimuli elicited significant frontoparietal activations, unlike AO or VO.
- Higher HbO activity correlated with positive valence in VO and arousal in AV.
Conclusions:
- Sensory modality critically influences both brain activity and behavioral evaluations in emotion perception.
- The frontoparietal network shows modality-dependent activation patterns.
- Audiovisual integration plays a key role in processing emotional arousal.
Related Concept Videos
01:25Factors Affecting Perception
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
01:15Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
01:26Introduction to Special Senses
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:23Somatosensory, Motor, and Association Cortex
The somatosensory cortex in the parietal lobes is crucial for interpreting sensory data such as touch, temperature, and proprioception. The somatosensory cortex, situated in the parietal lobes, plays a vital role in interpreting sensory information like touch, temperature, and proprioception—awareness of body position. This specialized brain region features an organized structure wherein neurons at the top primarily process sensations originating from the lower body. In contrast, those at the...
01:28Perception
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...