Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Facial Feedback Hypothesis

Facial Feedback Hypothesis

Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role of...

Social Facilitation

Social Facilitation

Not all intergroup interactions lead to negative outcomes. Sometimes, being in a group situation can improve performance. Social facilitation occurs when an individual performs better when an audience is watching than when the individual performs the behavior alone. This typically occurs when people are performing a task for which they are skilled.

Framing Effects

Framing Effects

Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in different ways based on the...

Non-Verbal Cues

Non-Verbal Cues

Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...

Lateralization

Lateralization

Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.

Language and Cognition

Language and Cognition

Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Usefulness of routine clinical follow-up after oral cavity cancer treatment: a single-center retrospective study.

European journal of surgical oncology : the journal of the European Society of Surgical Oncology and the British Association of Surgical Oncology·2026

Same author

Event-Related Potentials as Markers of Age-Related Changes of Spatial Hearing in Normal-Hearing Adults.

Trends in hearing·2026

Same author

Optimizing short-channel regression in fNIRS: an empirical evaluation with ecological audiovisual stimuli.

Neurophotonics·2026

Same author

The evolution of spatial patterns of brain activity during development and their role in the functional specialization of brain networks.

NeuroImage·2025

Same author

Editorial, Hear Res 2024.

Hearing research·2025

Same author

Capturing Visual Attention With Perturbed Auditory Spatial Cues.

Trends in hearing·2023

Search research articles

Related Experiment Video

Updated: Jun 17, 2026

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Cross-modal facilitation in speech prosody.

Jessica M Foxton¹, Louis-David Riviere, Pascal Barone

¹Université de Toulouse, UPS, Centre de Recherche Cerveau et Cognition, France CNRS, CerCo, Toulouse, France.

|December 18, 2009

Summary

This summary is machine-generated.

Visual cues like head movements significantly enhance the perception of speech prosody, improving sensitivity to auditory changes in pitch and loudness. This research highlights how visual prosody aids overall speech processing.

More Related Videos

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Related Experiment Videos

Last Updated: Jun 17, 2026

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Area of Science:

Psycholinguistics
Auditory Perception
Visual Speech Processing

Background:

Speech prosody traditionally analyzed via auditory features.
Visual prosodic cues (head/eyebrow movements) correlate with auditory features.
Limited research on visual prosody's impact on auditory perception.

Purpose of the Study:

Investigate how visual prosodic features influence the perception of auditory speech features.
Determine if visual cues enhance sensitivity to auditory changes in pitch and amplitude.
Explore the role of visual prosody in overall speech processing.

Main Methods:

Participants viewed videos of a speaker emphasizing one of two words.
Trials involved comparing identical auditory stimuli with stimuli differing in pitch or amplitude.
Congruent and incongruent visual-auditory conditions were compared against an auditory-alone baseline.
Perceptual thresholds for detecting auditory differences were measured.

Main Results:

Congruent visual-auditory conditions yielded better thresholds than incongruent ones for both pitch and amplitude.
Congruent amplitude thresholds outperformed auditory-alone thresholds, indicating enhanced loudness perception.
Visual prosodic features significantly affected auditory thresholds for pitch and amplitude changes.

Conclusions:

Visual stimuli demonstrably influence auditory thresholds for pitch and amplitude variations.
Visual prosody enhances speech processing by improving sensitivity to auditory cues.
Multimodal integration of visual and auditory information is crucial for effective speech perception.