Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Labeling Emotion01:20

Labeling Emotion

229
Emotional labeling is a cognitive process that involves identifying and naming one's emotions, such as anger, fear, happiness, or sadness. It allows individuals to recognize and express their internal emotional states, a critical aspect of emotional regulation and communication. Labeling emotions requires more than mere recognition; it also involves drawing upon memory and contextual cues to understand the current situation and apply a corresponding emotional label. For instance, feeling...
229
Physiology of Emotion01:20

Physiology of Emotion

1.3K
The physiology of emotions is a multifaceted process involving the autonomic nervous system, brain structures, hormones, and neurotransmitters. This intricate interplay dictates how emotions manifest in the body and influence behavior.
Autonomic Nervous System
The autonomic nervous system (ANS) plays a critical role in emotional responses by regulating involuntary physiological functions. It consists of two main components: the sympathetic and parasympathetic systems. The sympathetic system...
1.3K
Parallel Processing01:20

Parallel Processing

215
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
215
Cognitive Theories: Schachter-Singer Theory of Emotion01:20

Cognitive Theories: Schachter-Singer Theory of Emotion

561
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
561
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

235
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
235
Physiological Theories: James-Lange Theory of Emotion01:16

Physiological Theories: James-Lange Theory of Emotion

857
The James-Lange theory of emotion, proposed by William James and Carl Lange in the late 19th century, asserts that emotions are the result of physiological reactions to external stimuli. Contrary to the traditional view, which suggests that emotions directly arise from the perception of stimuli, this theory proposes that emotions occur as a consequence of the body's responses to such stimuli. According to this framework, an emotional experience is a cognitive interpretation of physiological...
857

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

From barriers to benefits: A personalized sleep intervention enhances sleep duration and emotional health in chronic short sleepers.

British journal of psychology (London, England : 1953)·2026
Same author

The effect of mask use on cross-race face perception: a simultaneous EEG and eye-tracking study.

Cognitive research: principles and implications·2026
Same author

Comparability between AI and human cognition and its role in psychological research and AI ethics.

British journal of psychology (London, England : 1953)·2026
Same author

Measuring the semantic priming effect across many languages.

Nature human behaviour·2025
Same author

Impact of mask use on facial emotion recognition in individuals with subclinical social anxiety: an eye-tracking study.

Cognitive research: principles and implications·2025
Same author

Understanding the role of eye movement pattern and consistency during face recognition through EEG decoding.

NPJ science of learning·2025

Related Experiment Video

Updated: Sep 1, 2025

Loneliness Assuaged: Eye-Tracking an Audience Watching Barrage Videos
06:45

Loneliness Assuaged: Eye-Tracking an Audience Watching Barrage Videos

Published on: May 29, 2020

4.3K

Differential audiovisual information processing in emotion recognition: An eye-tracking study.

Yueyuan Zheng1, Janet H Hsiao1

  • 1Department of Psychology, University of Hong Kong.

Emotion (Washington, D.C.)
|August 18, 2022
PubMed
Summary

Dynamic emotion recognition relies on audiovisual cues. Disgust recognition shows less automatic audiovisual association, requiring more attention and impacting eye movements differently than other emotions.

More Related Videos

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.1K
Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
10:41

Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content

Published on: May 26, 2018

7.0K

Related Experiment Videos

Last Updated: Sep 1, 2025

Loneliness Assuaged: Eye-Tracking an Audience Watching Barrage Videos
06:45

Loneliness Assuaged: Eye-Tracking an Audience Watching Barrage Videos

Published on: May 29, 2020

4.3K
Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury
05:51

Exploring the Use of Isolated Expressions and Film Clips to Evaluate Emotion Recognition by People with Traumatic Brain Injury

Published on: May 15, 2016

9.1K
Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content
10:41

Using Electroencephalography Measurements and High-quality Video Recording for Analyzing Visual Perception of Media Content

Published on: May 26, 2018

7.0K

Area of Science:

  • Cognitive Psychology
  • Neuroscience
  • Human-Computer Interaction

Background:

  • Dynamic emotion recognition often involves strong audiovisual association, where facial or vocal cues automatically trigger processing in the other modality.
  • The automaticity of this audiovisual association may vary across different emotions, influencing how multimodal information is processed.

Purpose of the Study:

  • To investigate whether different emotions exhibit varying degrees of automaticity in audiovisual association.
  • To examine how this differential automaticity affects audiovisual information processing during emotion recognition.

Main Methods:

  • Participants judged emotions from talking-head videos under audiovisual, video-only, and audio-only conditions.
  • Eye-movement patterns were tracked across conditions to assess information processing and attentional focus.
  • Recognition accuracy was compared across unimodal and audiovisual conditions for six basic emotions.

Main Results:

  • Disgust recognition demonstrated the largest audiovisual advantage in accuracy compared to unimodal conditions.
  • Eye-movement patterns remained consistent across conditions for most emotions, indicating mandatory audiovisual processing.
  • Disgust recognition showed altered eye-movement patterns in the audiovisual condition, suggesting interference from vocal cues and less automatic audiovisual association.

Conclusions:

  • The automaticity of audiovisual association in emotion recognition is influenced by associative learning, with later-learned emotions like disgust being less automatic.
  • Disgust recognition demands greater attentional resources due to less automatic audiovisual integration.
  • Findings highlight the role of associative learning in shaping real-life emotion recognition and multimodal learning.