Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Parallel Processing01:20

Parallel Processing

791
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
791
Automatic Processing and Automatic Social Behavior01:28

Automatic Processing and Automatic Social Behavior

274
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
274
Auditory Pathway01:15

Auditory Pathway

7.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.6K
Auditory Perception01:17

Auditory Perception

1.2K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.2K
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

624
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
624
Integration by Parts: Problem Solving01:29

Integration by Parts: Problem Solving

80
Smart speakers process voice commands by modeling audio inputs as piecewise functions and analyzing them through integration against trigonometric functions, such as cosine. This mathematical approach is fundamental in signal processing, where complex sound waves are decomposed into simpler frequency components.Consider a definite integral involving a piecewise function multiplied by a cosine function. Because the function is defined differently over separate intervals, the integral is split...
80

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Loudness changes as a function of the audiovisual scene.

Scientific reports·2026
Same author

Prediction Gone Awry: A Computational Framework for Emotion Dysregulation Across Autism and Attention-Deficit/Hyperactivity Disorder.

Journal of child and adolescent psychopharmacology·2026
Same author

The Role of Movement on the Development of the Audiotactile Temporal Binding Window.

Developmental science·2026
Same author

Efficacy of electronic travel aids for the blind and visually impaired during wayfinding.

Scientific reports·2026
Same author

Learning visual to auditory sensory substitution reveals flexibility in image to sound mapping.

NPJ science of learning·2025
Same author

Sex-Specific, Intermediate Behavioral Phenotypes in Heterozygous Dopamine Transporter Mutant DAT T356M Mice.

Genes, brain, and behavior·2025
Same journal

Sensorimotor Adaptation of Vocal Pitch Is Impaired in Cerebellar Ataxia.

Journal of cognitive neuroscience·2026
Same journal

Memory in the Palm of Your Hand: Smartphone-based Methods for Measuring Memory in the Wild.

Journal of cognitive neuroscience·2026
Same journal

Processing Asymmetry in Object-modifying Relative Clauses: Evidence from Functional Connectivity.

Journal of cognitive neuroscience·2026
Same journal

Extensive Experience Remodels Neural Task Circuitry to Escape the Frontal Bottleneck and Increase Automaticity of Categorization.

Journal of cognitive neuroscience·2026
Same journal

Investigating the Effects of Acute Stress on Neural Mechanisms of Self-controlled Decision-making.

Journal of cognitive neuroscience·2026
Same journal

Distilling the Neurophenomenological Signatures of Pure Awareness during Transcendental Meditation.

Journal of cognitive neuroscience·2026
See all related articles

Related Experiment Video

Updated: Feb 18, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

17.2K

Integration and Temporal Processing of Asynchronous Audiovisual Speech.

David M Simon1, Mark T Wallace1

  • 1Vanderbilt University.

Journal of Cognitive Neuroscience
|November 14, 2017
PubMed
Summary
This summary is machine-generated.

Visual speech significantly enhances auditory speech perception, especially in noise. Brain responses show reduced latency and amplitude when visual cues align temporally with speech, impacting theta brainwave activity and predicting performance.

More Related Videos

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.9K
Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

17.0K

Related Experiment Videos

Last Updated: Feb 18, 2026

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

17.2K
Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
05:38

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

Published on: June 29, 2021

2.9K
Infant Auditory Processing and Event-related Brain Oscillations
06:34

Infant Auditory Processing and Event-related Brain Oscillations

Published on: July 1, 2015

17.0K

Area of Science:

  • Neuroscience
  • Auditory Perception
  • Multisensory Integration

Background:

  • Visual speech provides perceptual benefits for auditory speech, particularly in noisy environments.
  • Previous studies show visual speech shortens auditory event-related potential (ERP) latency and reduces amplitude.

Purpose of the Study:

  • To investigate how the temporal relationship between visual and auditory speech streams affects neural processing.
  • To determine the dependency of ERP modulation on audiovisual speech synchrony.

Main Methods:

  • Electroencephalography (EEG) was used to record brain responses.
  • Time-frequency analysis was applied to examine neural oscillations in theta and alpha bands.
  • Correlation between neural activity and behavioral performance was assessed.

Main Results:

  • ERP latency reduction and amplitude suppression were maximal when visual speech preceded auditory speech by a narrow interval.
  • Increasing asynchrony between visual and auditory speech continuously diminished these ERP effects.
  • Theta and alpha band oscillations, particularly lower theta (3.5-5 Hz), showed significant modulation and predicted task performance.

Conclusions:

  • The neural suppression of auditory speech-by-visual speech is highly dependent on the temporal synchrony of the inputs.
  • Late theta oscillations may serve as an index for incongruity processing and reflect neural correlates of multisensory temporal perception.
  • Optimal audiovisual speech integration relies on precise temporal alignment.