Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Visual System01:26

Visual System

468
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
468
Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

706
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
706
Auditory Pathway01:15

Auditory Pathway

4.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.6K
Hearing01:31

Hearing

51.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.7K
Motor and Sensory Areas of the Cortex01:14

Motor and Sensory Areas of the Cortex

2.7K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
2.7K
Vision01:24

Vision

52.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Generative Artificial Intelligence: Implications for Families and Pediatricians.

Pediatrics·2026
Same author

Leveraging 10 Days of Alert Malfunction to Improve Mature Organizational Clinical Decision Support Processes.

Applied clinical informatics·2026
Same author

A systems engineering approach to alarm management on pediatric medical-surgical units.

Journal of hospital medicine·2024
Same author

Additive manufacturing (3d printing) in response to a pandemic: Lessons learned at the children's hospital of Philadelphia.

Annals of 3D printed medicine·2024
Same author

Pediatric Characteristics Associated With Higher Rates of Monitor Alarms.

Biomedical instrumentation & technology·2024
Same author

Integration of the CLEFT-Q Patient-Reported Outcome Tool into a Multidisciplinary Cleft and Craniofacial Clinic: A Proof of Concept.

Plastic and reconstructive surgery·2023

Related Experiment Video

Updated: May 23, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.4K

Primitive audiovisual integration of speech.

Robert E Remez1, Kathryn R Dubowski2, Daria F Ferro3

  • 1Department of Psychology and Program in Cognitive Science, Barnard College, Columbia University, 3009 Broadway, New York, NY, 10027-6598, USA. remez@columbia.edu.

Attention, Perception & Psychophysics
|March 7, 2025
PubMed
Summary

Audiovisual sensory integration makes unintelligible speech intelligible. This process, crucial for speech perception, relies on early, non-phonetic integration between sight and sound, even with imperfect signals.

Keywords:
Multisensory processingSpeech perception

More Related Videos

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.3K
Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities
09:38

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities

Published on: January 29, 2014

10.7K

Related Experiment Videos

Last Updated: May 23, 2025

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

16.4K
Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.3K
Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities
09:38

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities

Published on: January 29, 2014

10.7K

Area of Science:

  • Cognitive Science
  • Auditory Perception
  • Visual Perception

Background:

  • Speech perception typically relies on both auditory and visual cues.
  • Understanding how the brain integrates information from different senses is key to cognitive science.

Purpose of the Study:

  • To investigate the mechanisms of audiovisual sensory integration in speech perception.
  • To determine the role of phonetic and non-phonetic information in this integration process.

Main Methods:

  • Presenting unintelligible visual speech with a synchronized, unintelligible acoustic sinusoid.
  • Testing intelligibility under conditions of varying synchrony and sensory stream lead-lag.
  • Analyzing the contribution of unimodal and bimodal Gestalt principles.

Main Results:

  • Audiovisual integration rendered the speech intelligible, demonstrating robust sensory fusion.
  • Integration occurred even without resolving linguistic details in individual modalities.
  • Integration persisted despite desynchronization, particularly when visual input preceded auditory input.

Conclusions:

  • Early, non-phonetic sensory integration plays a significant role in audiovisual speech perception.
  • The temporal dynamics of sensory input critically influence audiovisual speech intelligibility.
  • Audiovisual coherence can be achieved even with unnatural auditory components, highlighting the brain's integrative power.