Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensory Modalities01:15

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Synesthesia01:27

Synesthesia

Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Introduction to Special Senses01:26

Introduction to Special Senses

Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Scene complexity and the detail trace of human long-term visual memory.

Vision research·2024
Same author

Signals of global symmetry are important for abnormality detection in mammograms.

Journal of medical imaging (Bellingham, Wash.)·2023
Same author

Reliability of radiologists' first impression when interpreting a screening mammogram.

PloS one·2023
Same author

Early signs of cancer present in the fine detail of mammograms.

PloS one·2023
Same author

Characterising and dissecting human perception of scene complexity.

Cognition·2022
Same author

Modulating human memory for complex scenes with artificially generated images.

Scientific reports·2022
Same journal

Analysis of human visual experience data.

Journal of vision·2026
Same journal

Pyramid-based Bayesian modeling for high-resolution behavioral analysis.

Journal of vision·2026
Same journal

Sensation without perception: The white whale effect and perceptual blindness in autonomous vehicles.

Journal of vision·2026
Same journal

Gaze behavior during closed-captioned movie viewing adapts to absent audio through more frequent switching between text and scene.

Journal of vision·2026
Same journal

In pursuit of saccade awareness: Limited volitional control and minimal conscious access to catch-up saccades during smooth pursuit eye movements.

Journal of vision·2026
Same journal

Dissociable effects of element-lifetime and stimulus-duration on local and global motion processing: An equivalent noise study.

Journal of vision·2026
See all related articles

Related Experiment Video

Updated: Jun 16, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Natural cross-modal mappings between visual and auditory features.

Karla K Evans1, Anne Treisman

  • 1Brigham and Women's Hospital and Harvard Medical School, Cambridge, MA 02139, USA. kevans@search.bwh.harvard.edu

Journal of Vision
|February 11, 2010
PubMed
Summary
This summary is machine-generated.

The brain automatically links sound pitch to visual features like location and size, even without conscious awareness. This cross-modal interaction enhances sensory perception and response speed.

Related Experiment Videos

Last Updated: Jun 16, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

  • Cognitive Neuroscience
  • Sensory Perception
  • Cross-modal Integration

Background:

  • The brain integrates multisensory information to improve object detection and response selection.
  • Evidence suggests subconscious cross-modal influences on perceptual experiences.
  • Understanding automatic sensory interactions is key to comprehending brain function.

Purpose of the Study:

  • To investigate automatic cross-modal mappings between auditory and visual features.
  • To determine if these interactions occur without conscious awareness.
  • To localize these interactions within the perceptual system.

Main Methods:

  • Conducted speeded classification tasks involving auditory and visual stimuli.
  • Examined spontaneous associations between auditory pitch and visual features (location, size, spatial frequency, contrast).
  • Dissociated task variables from cross-modal features to assess automaticity.

Main Results:

  • Found spontaneous mappings between auditory pitch and visual vertical location, size, and spatial frequency.
  • No significant mapping was observed between pitch and visual contrast.
  • Cross-modal interactions occurred automatically, independent of task demands.

Conclusions:

  • The brain exhibits automatic, subconscious cross-modal integration between specific auditory and visual features.
  • These interactions appear to occur at the perceptual level, influencing how we process sensory input.
  • Findings contribute to understanding the automatic nature of multisensory perception.