Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Non-Verbal Cues01:29

Non-Verbal Cues

784
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
784
Therapeutic Communication01:30

Therapeutic Communication

8.9K
Communication is a lifelong learning process. Through therapeutic communication, nurses can collect relevant assessment data, provide education and counseling, and interact during nursing interventions. Sending and receiving messages occur through verbal and nonverbal communication techniques and can happen separately or simultaneously.
Verbal communication depends on language or a prescribed way of using words so that people can share information effectively. The critical aspects of verbal...
8.9K
Introducing Social Perception01:29

Introducing Social Perception

717
Perceiving others accurately is fundamental to effective communication and relationship-building. Social perception, a key concept in social psychology, refers to the cognitive processes through which individuals gather and interpret information about others to understand their actions, intentions, and motivations. This process extends beyond spoken words and overt behaviors, incorporating subtle nonverbal cues and contextual factors.Nonverbal Cues and Their SignificanceNonverbal cues play a...
717
Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

956
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
956
Factors Affecting Perception01:25

Factors Affecting Perception

3.3K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
3.3K
Role of Affect in Interpersonal Attraction01:24

Role of Affect in Interpersonal Attraction

367
Affect plays a crucial role in shaping interpersonal evaluations and perceptions. Emotions influence how individuals judge and respond to others, often determining whether interactions are viewed positively or negatively. This effect can manifest directly through interactions with the person in question or indirectly via associations with unrelated emotional experiences.Direct Effects of Affect on AttractionAffect directly influences interpersonal attraction when a person’s behavior...
367

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Letters are functional in word identification.

Memory & cognition·2013
Same author

Modeling face identification processing in children and adults.

Journal of experimental child psychology·2001
Same author

Bayes factor of model selection validates FLMP.

Psychonomic bulletin & review·2001
Same author

Tests of auditory-visual integration efficiency within the framework of the fuzzy logical model of perception.

The Journal of the Acoustical Society of America·2000
Same author

Speech perception in perceivers with hearing loss: synergy of multiple modalities.

Journal of speech, language, and hearing research : JSLHR·1999
Same author

Laterality in visual speech perception.

Journal of experimental psychology. Human perception and performance·1998
Same journal

Mind wandering during first- and foreign-language reading.

Psychonomic bulletin & review·2026
Same journal

Lexical word processing is unaffected by rapid invisible frequency tagging in reading: Evidence from eye movements.

Psychonomic bulletin & review·2026
Same journal

Anxiety modulates voluntary attentional orienting to emotional gaze cues: Eye movements for pro- and anti-saccades.

Psychonomic bulletin & review·2026
Same journal

Faster key-press responses to front vowels than back vowels when matching heard vowels with represented vowels.

Psychonomic bulletin & review·2026
Same journal

Testing the interleaving effect without response bias: A forced-choice reevaluation of Kornell and Bjork (2008).

Psychonomic bulletin & review·2026
Same journal

The impact of social interaction on abstract concepts.

Psychonomic bulletin & review·2026
See all related articles

Related Experiment Video

Updated: May 6, 2026

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.8K

Perceiving affect from the voice and the face.

D W Massaro1, P B Egan

  • 1Program in Experimental Psychology, Clark Kerr Hall, University of California, 95064, Santa Cruz, CA, massaro@fuzzy.ucsc.edu.

Psychonomic Bulletin & Review
|November 12, 2013
PubMed
Summary
This summary is machine-generated.

People integrate facial and vocal cues to perceive emotion. When one cue is ambiguous, the other

More Related Videos

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.6K
Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans
04:27

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

Published on: March 15, 2019

11.3K

Related Experiment Videos

Last Updated: May 6, 2026

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.8K
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.6K
Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans
04:27

Using Facial Electromyography to Assess Facial Muscle Reactions to Experienced and Observed Affective Touch in Humans

Published on: March 15, 2019

11.3K

Area of Science:

  • Psychology
  • Cognitive Science
  • Human-Computer Interaction

Background:

  • Emotion perception relies on multimodal sensory information.
  • Understanding how visual and auditory cues are integrated is crucial for fields like psychology and AI.

Purpose of the Study:

  • To investigate how individuals perceive emotion using combined facial and vocal cues.
  • To determine the influence of unimodal versus multimodal emotional stimuli on perception.
  • To compare the efficacy of different models (fuzzy logical vs. additive) in explaining emotion perception.

Main Methods:

  • Utilized computer-generated facial expressions and recorded vocalizations of a neutral word in simulated emotional states.
  • Presented 15 stimuli combinations: visual cues alone, vocal cues alone, and combined visual-vocal cues.
  • Subjects performed a two-alternative forced choice task, classifying stimuli as HAPPY or ANGRY.

Main Results:

  • Individuals integrate information from both visual (facial) and auditory (vocal) modalities for emotion perception.
  • The impact of one sensory modality on perception increases when the other modality is ambiguous (neutral).
  • The Fuzzy Logical Model of Perception (FLMP) provided a significantly better fit to the data than an additive model.

Conclusions:

  • Emotion perception is a complex process involving the integration of multiple sensory inputs.
  • The FLMP offers a more robust framework for understanding multimodal emotion perception than simple additive models.
  • Findings challenge theories emphasizing unimodal influence or additive cue combination in emotion recognition.