Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Interference: Path Lengths01:10

Interference: Path Lengths

Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of information more...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The relative psychometric function: A general analysis framework for relating psychological processes.

Psychological review·2026
Same author

Dynamic cortical routing mediates temporal attention.

bioRxiv : the preprint server for biology·2026
Same author

Using Artificial Neural Networks to Relate External Sensory Features to Internal Decisional Evidence.

Open mind : discoveries in cognitive science·2026
Same author

Clarifying the conceptual dimensions of representation in neuroscience.

Nature reviews. Neuroscience·2026
Same author

A neural signature of adaptive mentalization.

Nature neuroscience·2026
Same author

Voluntary temporal attention improves perception even in the absence of temporal competition.

bioRxiv : the preprint server for biology·2026
Same journal

Characterizing facilitators and barriers to Hypoglycemic Confidence among patients with diabetes: a qualitative descriptive study.

Frontiers in psychology·2026
Same journal

Psychometric evaluation and refinement of the 7DHW questionnaire for the German population.

Frontiers in psychology·2026
Same journal

Editorial: Ethical leadership and workplace equity: mediating and moderating mechanisms in emotional labor and well-being.

Frontiers in psychology·2026
Same journal

How organizational support promotes teacher professional recognition: a perspective on teachers' autonomous learning and teaching abilities.

Frontiers in psychology·2026
Same journal

From "performance competition arena" to "psychological exemption zone": psychological safety mechanisms in reverse mobility.

Frontiers in psychology·2026
Same journal

General and sport-specific mental toughness in university students: associations with personality traits and physical activity.

Frontiers in psychology·2026
See all related articles

Related Experiment Video

Updated: May 14, 2026

Eye Movements in Visual Duration Perception: Disentangling Stimulus from Time in Predecisional Processes
09:27

Eye Movements in Visual Duration Perception: Disentangling Stimulus from Time in Predecisional Processes

Published on: January 19, 2024

Temporal structure and complexity affect audio-visual correspondence detection.

Rachel N Denison1, Jon Driver, Christian C Ruff

  • 1UCL Institute of Cognitive Neuroscience, University College London London, UK ; Helen Wills Neuroscience Institute, University of California Berkeley, CA, USA.

Frontiers in Psychology
|January 25, 2013
PubMed
Summary
This summary is machine-generated.

Humans detect relatedness between auditory and visual streams by recognizing shared temporal structure, not just coincidence. Complex patterns enhance this multisensory perception, even with slight timing delays.

Keywords:
crossmodalinformation theorymultisensoryperceptual correspondenceperceptual timingsynchrony

More Related Videos

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
13:00

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

Published on: January 23, 2017

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Related Experiment Videos

Last Updated: May 14, 2026

Eye Movements in Visual Duration Perception: Disentangling Stimulus from Time in Predecisional Processes
09:27

Eye Movements in Visual Duration Perception: Disentangling Stimulus from Time in Predecisional Processes

Published on: January 19, 2024

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
13:00

Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

Published on: January 23, 2017

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder
09:13

Testing Sensory and Multisensory Function in Children with Autism Spectrum Disorder

Published on: April 22, 2015

Area of Science:

  • Cognitive Neuroscience
  • Auditory-Visual Perception
  • Multisensory Integration

Background:

  • Temporal synchrony is traditionally viewed as crucial for multisensory integration.
  • Previous research focused on temporal coincidence as the primary cue for linking sensory inputs.
  • The role of complex temporal patterns in multisensory perception remains less understood.

Purpose of the Study:

  • To investigate if humans utilize temporal structure, beyond mere coincidence, to detect audio-visual relatedness.
  • To determine the influence of temporal pattern complexity on multisensory correspondence detection.
  • To explore the limits of temporal lag in perceiving audio-visual stream matching.

Main Methods:

  • Psychophysical experiments using rapid streams of auditory and visual events.
  • Participants judged the relatedness of audio-visual streams based on shared temporal structure.
  • Varied temporal patterns (stochastic vs. rhythmic) and crossmodal lags were employed.

Main Results:

  • Humans can detect matching audio-visual streams through shared temporal structure up to 200ms lags.
  • No significant advantage was found for perfectly synchronous streams compared to lagged ones.
  • Stochastic, complex temporal patterns yielded higher audio-visual matching sensitivity than rhythmic patterns.

Conclusions:

  • Temporal structure, particularly its complexity, is a key determinant in detecting audio-visual correspondence.
  • The findings challenge the exclusive focus on synchrony, highlighting pattern recognition in multisensory integration.
  • This research offers novel paradigms for studying audio-visual temporal perception deficits in special populations.