Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Associative Learning01:27

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of information more...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Encoding01:19

Encoding

Information enters the brain through encoding, which is the input of information into the memory system. Once sensory information is received from the environment, the brain labels or codes it. The information is then organized with similar information and connected to existing concepts. Encoding occurs through automatic processing and effortful processing.
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Living in a digital ecology: The impact on social interaction, learning, and language development.

Developmental psychology·2026
Same author

Using Eye Tracking to Examine Effects of Overt Localization on Referential Processing in German Sign Language Sentence Processing.

Journal of psycholinguistic research·2026
Same author

Parent Speech in Free Play Is Guided by Infant Attention, But Organized by Object Familiarity.

Infancy : the official journal of the International Society on Infant Studies·2026
Same author

Maternal information sampling targets children's knowledge gaps.

Acta psychologica·2026
Same author

Communicative Development Inventories (CDIs) in etiologically diverse developmental conditions: A systematic review.

Research in developmental disabilities·2026
Same author

Children's individual interests are sustained across development and predict later vocabulary development.

Journal of child language·2025

Related Experiment Video

Updated: May 16, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Speaker identity supports phonetic category learning.

Nivedita Mani1, Signe Schneider

  • 1Language Acquisition Junior Research Group, University of Göttingen, Gosslerstrasse 14, Göttingen, Germany. nmani@gwdg.de

Journal of Experimental Psychology. Human Perception and Performance
|November 15, 2012
PubMed
Summary

Visual speaker identity aids speech sound discrimination. Consistent pairing of faces with sounds improves the brain's ability to detect phoneme changes, enhancing speech processing.

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Related Experiment Videos

Last Updated: May 16, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Area of Science:

  • Cognitive Neuroscience
  • Auditory Perception
  • Speech Processing

Background:

  • Visual cues from a speaker's face, including mouth movements, enhance speech sound discrimination in adults.
  • A speaker's face also provides a visual indexical cue of their identity, beyond articulatory information.

Purpose of the Study:

  • To investigate the separable encoding of speaker identity within speech processing.
  • To determine if speech discrimination is influenced by speaker identity.
  • To assess if consistent visual-auditory pairing of speakers and sounds affects the brain's discrimination of speech sounds.

Main Methods:

  • Participants were exposed to either consistent or inconsistent pairings of different speakers' faces with different speech sounds.
  • Event-related potentials (ERPs) were recorded to measure brain responses.
  • The ability to detect a phoneme change was assessed under these different pairing conditions.

Main Results:

  • Participants exposed to consistent speaker-sound pairings showed improved detection of phoneme changes.
  • This improvement was relative to participants exposed to inconsistent speaker-sound pairings.
  • The findings indicate that visual speaker identity influences speech processing.

Conclusions:

  • The brain appears to encode speaker identity separately during speech processing.
  • Visual information about speaker identity significantly influences the discrimination of speech sounds.
  • Consistent visual-auditory associations enhance the brain's sensitivity to phonetic changes.