Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

53.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
53.1K
Auditory Perception01:17

Auditory Perception

594
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
594
Perception of Sound Waves01:01

Perception of Sound Waves

4.7K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.7K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

436
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
436
The Cochlea01:13

The Cochlea

46.0K
The cochlea is a coiled structure in the inner ear that contains hair cells—the sensory receptors of the auditory system. Sound waves are transmitted to the cochlea by small bones attached to the eardrum called the ossicles, which vibrate the oval window that leads to the inner ear. This causes fluid in the chambers of the cochlea to move, vibrating the basilar membrane.
46.0K
Auditory Pathway01:15

Auditory Pathway

5.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Integrative Music Therapy for Depression-related Disorders (iMTDep) - study protocol for a randomised controlled trial.

Trials·2026
Same author

Seeing Scent in Sound: Exploratory Spontaneous Visual and Olfactory Mental Imagery Elicited by Musical Modes.

Multisensory research·2026
Same author

Material Dependency of Crossmodal Correspondences in Shitsukan (with a Focus on Food).

Multisensory research·2026
Same author

Tasting Accents: Three Studies on the Influence of Regional Accents on People's Expectations and Perception of Food.

Multisensory research·2026
Same author

Assessing the role(s) of human touch in immersive entertainment.

i-Perception·2026
Same author

What does sci-fi taste like? Metallic taste associated with the sound of the theremin.

Perception·2026

Related Experiment Video

Updated: Sep 17, 2025

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
11:15

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals

Published on: May 23, 2017

7.3K

Exploring auditory morphodynamics: Audiovisual associations in sound-based music.

Riccardo Wanke1, Alessandro Ansani2, Nicola Di Stefano3

  • 1University of Coimbra, Portugal.

I-Perception
|July 3, 2025
PubMed
Summary

This study reveals shared perceptual criteria for audiovisual associations in experimental music. Listeners consistently matched sound-based music with abstract images based on features like smoothness and continuity.

Keywords:
audiovisual associationscrossmodal correspondencescrossmodalitymorphodynamic theorysound-based music

More Related Videos

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.6K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.1K

Related Experiment Videos

Last Updated: Sep 17, 2025

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals
11:15

fMRI Mapping of Brain Activity Associated with the Vocal Production of Consonant and Dissonant Intervals

Published on: May 23, 2017

7.3K
A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.6K
Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.1K

Area of Science:

  • Psychology
  • Musicology
  • Crossmodal Perception

Background:

  • Crossmodal research extensively studies traditional music genres.
  • The perceptual potential of sound-based music in crossmodal associations is underexplored.
  • Contemporary and experimental music practices offer unique avenues for studying audiovisual perception.

Purpose of the Study:

  • To investigate audiovisual associations in sound-based music genres like spectralism and electronic-glitch.
  • To identify implicit perceptual criteria guiding listener judgments in crossmodal perception.
  • To bridge the gap in psychological research concerning sound-based music and crossmodal interactions.

Main Methods:

  • An online experiment involving 152 participants.
  • Exposure to six musical excerpts from spectralism and electronic-glitch music.
  • Rating of audiovisual congruence between music and abstract images based on shared features.

Main Results:

  • High consistency in participant ratings, suggesting shared perceptual criteria.
  • Identification of key factors influencing audiovisual associations: smoothness, continuity, numericity, symmetry, and spectrotemporal dimensions.
  • Evidence for Gestalt and morphodynamic principles underlying crossmodal perception in sound-based music.

Conclusions:

  • Shared implicit perceptual criteria, rooted in Gestalt and morphodynamic features, govern audiovisual associations in sound-based music.
  • Findings have implications for crossmodal research, musicology, and understanding aesthetic experiences.
  • Future research should explore further audiovisual associations using diverse sound-based music genres.