Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensory Modalities01:15

Sensory Modalities

3.6K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.6K
Auditory Perception01:17

Auditory Perception

949
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
949
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

858
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
858
Perception of Sound Waves01:01

Perception of Sound Waves

5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K
Introduction to Special Senses01:26

Introduction to Special Senses

7.2K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
7.2K
Auditory Pathway01:15

Auditory Pathway

6.9K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
6.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Isolating fast and slow flows in three-dimensional fluid dynamics.

Scientific reports·2026
Same author

A Systematic Review of Communication-Focused Dementia Interventions for Indigenous Communities.

Dementia (London, England)·2025
Same author

Assessment and treatment of acquired stuttering: A single subject study.

Journal of fluency disorders·2025
Same author

The New Zealand Parkinson's progression programme.

Journal of the Royal Society of New Zealand·2024
Same author

Higher Frequency of Stuttered Disfluencies Negatively Affects Communicative Participation in Parkinson's Disease.

Journal of speech, language, and hearing research : JSLHR·2024
Same author

Assessing ultrasound probe stabilization for quantifying speech production contrasts using the Adjustable Laboratory Probe Holder for UltraSound (ALPHUS).

Journal of phonetics·2024

Related Experiment Video

Updated: Jan 2, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.9K

Tri-modal speech: Audio-visual-tactile integration in speech perception.

Donald Derrick1, Doreen Hansmann2, Catherine Theys2

  • 1New Zealand Institute of Language, Brain, and Behaviour, University of Canterbury, 20 Kirkwood Avenue, Upper Riccarton, Christchurch 8041, New Zealand.

The Journal of the Acoustical Society of America
|December 5, 2019
PubMed
Summary
This summary is machine-generated.

Visual and tactile information significantly impact speech perception. While visual cues greatly improve auditory signal identification in noise, tactile cues offer a smaller, additive benefit.

More Related Videos

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.5K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.4K

Related Experiment Videos

Last Updated: Jan 2, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.9K
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.5K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.4K

Area of Science:

  • Multisensory processing
  • Auditory perception
  • Speech communication

Background:

  • Speech perception is a multisensory process, influenced by visual and tactile information.
  • Previous research shows visual and tactile cues can enhance or interfere with auditory speech perception.
  • The combined effects of visual, tactile, and auditory information on speech perception remain under-investigated.

Purpose of the Study:

  • To investigate the combined influence of aero-tactile, visual, and auditory information on speech perception.
  • To quantify the effects of matching and mismatching visual and tactile speech stimuli on auditory syllable identification in noise.

Main Methods:

  • Participants performed two-way forced-choice auditory syllable-in-noise classification tasks.
  • The study manipulated the congruence of visual and tactile speech information presented alongside auditory signals.
  • Signal-to-noise ratio (SNR) thresholds for accurate identification were measured.

Main Results:

  • Both visual and tactile information altered the SNR threshold for auditory speech identification.
  • Visual information significantly improved SNR by 28.04 dB when matching visual and auditory stimuli.
  • Tactile information provided a smaller, additive benefit, with a 1.58 dB SNR match-mismatch range.

Conclusions:

  • Visual speech information exerts a strong influence on auditory speech perception in noise.
  • Tactile aero-tactile information has a smaller but additive effect on speech perception.
  • The integration of multiple sensory modalities (visual, tactile, auditory) is crucial for robust speech understanding.