Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

4.8K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.8K
Auditory Perception01:17

Auditory Perception

649
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
649
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

483
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
483
Synesthesia01:27

Synesthesia

222
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
222
Hearing01:31

Hearing

53.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
53.7K
Sensory Modalities01:15

Sensory Modalities

2.0K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
2.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Role of social competence in emotion processing among emerging adults with anxiety.

Scientific reports·2025
Same author

Posner's Endogenous Beam Is (Still) Not Treisman's Glue.

Experimental psychology·2025
Same author

An Automobile's Tail Lights: Sacrificing Safety for Playful Design?

Human factors·2024
Same author

Changes in the Networks of Attention across the Lifespan: A Graphical Meta-Analysis.

Journal of Intelligence·2024
Same author

Measuring the Interocular Delay and its Link to Visual Acuity in Amblyopia.

Investigative ophthalmology & visual science·2024
Same author

Is gaze cuing more like endogenous or exogenous orienting?

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2023
Same journal

Seeing Scent in Sound: Exploratory Spontaneous Visual and Olfactory Mental Imagery Elicited by Musical Modes.

Multisensory research·2026
Same journal

The Contextually Tolerant but Temporally Intolerant Sensation Transference from Tactile to Taste in Drinking Coffee.

Multisensory research·2026
Same journal

The Pip-and-Pop Effect in Depth: How Multisensory Stimuli Influence Depth Perception.

Multisensory research·2026
Same journal

Material Dependency of Crossmodal Correspondences in Shitsukan (with a Focus on Food).

Multisensory research·2026
Same journal

Shifting Fall Perception: How Virtual Reality Alters the Precision of Estimating Postural Instability Onset.

Multisensory research·2026
Same journal

Duration, Sequence and Beat Perception across Modalities.

Multisensory research·2026
See all related articles

Related Experiment Video

Updated: Oct 5, 2025

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki
07:31

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki

Published on: September 13, 2019

10.3K

Crossmodal Correspondence Between Auditory Timbre and Visual Shape.

Daniel Gurman1, Colin R McCormick1, Raymond M Klein1

  • 1Department of Psychology and Neuroscience, Dalhousie University, B3H 4R2, Halifax, NS, Canada.

Multisensory Research
|January 22, 2022
PubMed
Summary
This summary is machine-generated.

This study confirms crossmodal correspondences between auditory timbre and visual shape, replicating previous findings and discovering new associations. These timbre-shape links show consistent patterns and correlate with perceived meaning.

More Related Videos

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.1K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

568

Related Experiment Videos

Last Updated: Oct 5, 2025

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki
07:31

Investigating the Effect of Visual Imagery and Learning Shape-Audio Regularities on Bouba and Kiki

Published on: September 13, 2019

10.3K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.1K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

568

Area of Science:

  • Cognitive Psychology
  • Auditory Perception
  • Visual Perception

Background:

  • Crossmodal correspondences link unrelated stimuli (e.g., sound pitch and shape brightness).
  • Research extensively covers pitch and volume correspondences, but less on auditory timbre.
  • Adeli et al. (2014) provided initial evidence for timbre-shape correspondences.

Purpose of the Study:

  • To replicate and extend Adeli et al.'s findings on auditory timbre and visual shape correspondences.
  • To identify novel crossmodal correspondences involving auditory timbre.
  • To assess the utility of a semantic task in conjunction with an association task for studying crossmodal perception.

Main Methods:

  • Two computerized tasks were employed: an association task (matching sounds to shapes) and a semantic task (rating shapes and sounds on scales).
  • Participants matched sounds with specific timbral qualities to visual shapes.
  • Semantic ratings were collected for both auditory and visual stimuli.

Main Results:

  • Nonrandom selection patterns were observed in the association task, indicating consistent timbre-shape pairings.
  • Previously identified harsh/jagged and smooth/soft correspondences were replicated with high consistency.
  • Evidence for novel timbre-shape correspondences was found, involving timbres not previously studied.
  • A significant negative correlation (-0.36) between association and semantic data suggests linked perceptions.

Conclusions:

  • The study successfully replicated and expanded upon existing knowledge of crossmodal timbre-shape correspondences.
  • Novel associations between specific auditory timbres and visual shapes were identified.
  • The semantic task proved valuable in complementing association-based methods for crossmodal research.
  • The correlation between association and semantic data highlights the role of perceived meaning in crossmodal links.