Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

694
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
694
Perception of Sound Waves01:01

Perception of Sound Waves

4.9K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.9K
Factors Affecting Perception01:25

Factors Affecting Perception

2.1K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.1K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

558
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
558
Causes of Similarity-Dissimilarity Effect01:26

Causes of Similarity-Dissimilarity Effect

61
The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
61
Sensory Modalities01:15

Sensory Modalities

2.5K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
2.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Isolating fast and slow flows in three-dimensional fluid dynamics.

Scientific reports·2026
Same author

Velum movement in speech and inter-speech pause intervals: a cineradiographic study of French and English speech.

Phonetica·2025
Same author

Ethnokinesiology: towards a neuromechanical understanding of cultural differences in movement.

Philosophical transactions of the Royal Society of London. Series B, Biological sciences·2024
Same author

Assessing ultrasound probe stabilization for quantifying speech production contrasts using the Adjustable Laboratory Probe Holder for UltraSound (ALPHUS).

Journal of phonetics·2024
Same author

Tonguedness in speech: Lateral bias in lingual bracing.

JASA express letters·2024
Same author

Hearing, seeing, and feeling speech: the neurophysiological correlates of trimodal speech perception.

Frontiers in human neuroscience·2023
Same journal

From Contact to Conversation: Protactile Language, Modality, and Community.

Annual review of linguistics·2026
Same journal

Charting the Course of Aphasia Recovery: Factors, Trajectories, and Outcomes.

Annual review of linguistics·2026
Same journal

The Role of Health Care Communication in Treatment Outcomes.

Annual review of linguistics·2024
Same journal

Learning Through Processing: Toward an Integrated Approach to Early Word Learning.

Annual review of linguistics·2022
Same journal

Acquisition of Sign Languages.

Annual review of linguistics·2021
Same journal

Linguistic Aspects of Primary Progressive Aphasia.

Annual review of linguistics·2018
See all related articles

Related Experiment Video

Updated: Oct 26, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.5K

Cross-modal effects in speech perception.

Megan Keough1, Donald Derrick2,3, Bryan Gick1,4

  • 1Interdisciplinary Speech Research Lab, Department of Linguistics, University of British Columbia, Vancouver, British Columbia V6T 1Z4, Canada.

Annual Review of Linguistics
|July 26, 2021
PubMed
Summary
This summary is machine-generated.

Speech perception is multisensory, integrating audition, vision, and somatosenses. Research shows speech occupies a multidimensional sensory space, influenced by temporal factors and relevance, not just space.

Keywords:
cross-modal effectsmultisensorysomatosensationspeech perception

More Related Videos

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.2K
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.0K

Related Experiment Videos

Last Updated: Oct 26, 2025

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.5K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.2K
Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects
07:36

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

16.0K

Area of Science:

  • Speech research
  • Multisensory perception
  • Human-computer interaction

Background:

  • Traditional speech research focused on audition.
  • Recent research highlights the role of multisensory integration, including vision and somatosenses.
  • Somatosensory modalities like proprioception, pressure, vibration, and aerotactile sensation are relevant to speech experience and communication.

Purpose of the Study:

  • To review cross-modal effects in speech perception.
  • To examine both audiovisual and somatosensory influences on speech.
  • To explore the dimensionality of the sensory space occupied by speech.

Main Methods:

  • Literature review of audiovisual speech research.
  • Analysis of new findings on somatosensory effects in speech perception.
  • Synthesis of existing data on cross-modal interactions.

Main Results:

  • Cross-modal effects in speech perception are constrained by temporal congruence and signal relevance.
  • Spatial congruence does not appear to constrain these effects.
  • Speech perception occurs within a highly multidimensional sensory space, not limited to 1-3 dimensions.

Conclusions:

  • Speech perception is a complex, multidimensional sensory process.
  • Future research should investigate the interplay of various sensory modalities in speech.
  • Expanding research to include somatosensory modalities offers new insights into speech communication.