Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Sensory Modalities01:15

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Introduction to Special Senses01:26

Introduction to Special Senses

Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.
Factors Affecting Perception01:25

Factors Affecting Perception

Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Phonetic convergence enhances speech intelligibility.

Attention, perception & psychophysics·2025
Same author

The Benefit of Bimodal Training in Voice Learning.

Brain sciences·2023
Same author

Semantic priming from McGurk words: Priming depends on perception.

Attention, perception & psychophysics·2023
Same author

Selective adaptation in speech: Measuring the effects of visual and lexical contexts.

Journal of experimental psychology. Human perception and performance·2021
Same author

Cross-modal transfer of talker-identity learning.

Attention, perception & psychophysics·2020
Same author

The role of speech fidelity in the irrelevant sound effect: Insights from noise-vocoded speech backgrounds.

Quarterly journal of experimental psychology (2006)·2018
Same journal

Facing ambiguity: What we do in the space between stimulus and response.

Current directions in psychological science·2026
Same journal

Escaping the Jingle-Jangle Jungle: Increasing Conceptual Clarity in Psychology Using Large Language Models.

Current directions in psychological science·2026
Same journal

Emotional Acculturation: Emotions as a Pathway to Social Integration.

Current directions in psychological science·2026
Same journal

Historical Change in Midlife Development from a Cross-National Perspective.

Current directions in psychological science·2026
Same journal

Embodied and Embedded Learning: Child, Caregiver, and Context.

Current directions in psychological science·2026
Same journal

A Framework for Automation in Psychotherapy.

Current directions in psychological science·2025
See all related articles

Related Experiment Video

Updated: May 9, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Speech Perception as a Multimodal Phenomenon.

Lawrence D Rosenblum1

  • 1University of California, Riverside.

Current Directions in Psychological Science
|August 6, 2013
PubMed
Summary
This summary is machine-generated.

Speech perception combines auditory and visual cues. While amodal information processing was proposed, recent findings show higher cognitive factors influence this multimodal integration.

Keywords:
audiovisuallip readingmultimodalspeech

More Related Videos

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Related Experiment Videos

Last Updated: May 9, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Area of Science:

  • Cognitive Science
  • Neuroscience
  • Psycholinguistics

Background:

  • Speech perception is inherently multimodal, integrating auditory and visual (lip-reading) information.
  • Neuroimaging suggests the brain processes auditory and visual speech similarly, supporting amodal theories.
  • Amodal speech information processing explains automatic, immediate, and complete audiovisual speech integration.

Purpose of the Study:

  • To investigate the role of amodal information in speech perception.
  • To reconcile amodal theories with recent findings on cognitive influences in audiovisual speech integration.

Main Methods:

  • Review of existing neuroimaging and psycholinguistic research on speech perception.
  • Analysis of studies examining the influence of lexical status and semantic context on audiovisual speech integration.

Main Results:

  • Evidence supports the automatic and immediate integration of auditory and visual speech information.
  • Recent studies indicate that higher cognitive factors, such as lexical status and semantic context, modulate speech integration.
  • These findings challenge purely amodal accounts of speech perception.

Conclusions:

  • While amodal information processing plays a role, it does not fully explain audiovisual speech integration.
  • Higher cognitive processes significantly influence how auditory and visual speech information are integrated.
  • Future research must account for both low-level sensory processing and high-level cognitive modulation in speech perception.