Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Auditory Perception01:17

Auditory Perception

406
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
406
Sensory Modalities01:15

Sensory Modalities

1.4K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.4K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

290
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
290
Perception of Sound Waves01:01

Perception of Sound Waves

4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Hearing01:31

Hearing

52.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Local and global microstructural and functional thalamomotor connectivity alterations in Parkinson's disease following motor learning.

NPJ Parkinson's disease·2026
Same author

Spatial dynamics of flexible nanoswimmers under a rotating magnetic field.

Physical review. E·2026
Same author

Neural correlates of Parkinson's improvements after combined digital-levodopa therapy: a pilot study.

Brain communications·2026
Same author

Digital neuroplasticity modulation of the brain-immune axis: Translational strategies for neurodegenerative, psychiatric, and aging-related conditions.

Neural regeneration research·2026
Same author

Does nonsense make sense? A springboard to studying dynamic reconfiguration of large-scale networks during semantic and intonation speech processing.

NeuroImage·2025
Same author

Mobile application leads to psychological improvement and correlated neuroimmune function change in subjective cognitive decline.

NPJ digital medicine·2025

Related Experiment Video

Updated: Aug 6, 2025

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.2K

Shape detection beyond the visual field using a visual-to-auditory sensory augmentation device.

Shira Shvadron1,2, Adi Snir1,2, Amber Maimon1,2

  • 1Baruch Ivcher School of Psychology, The Baruch Ivcher Institute for Brain, Cognition, and Technology, Reichman University, Herzliya, Israel.

Frontiers in Human Neuroscience
|March 20, 2023
PubMed
Summary

Sighted individuals can expand their sensory perception using a visual-to-auditory sensory substitution device (SSD). This technology translates images into sound, enabling users to interpret information beyond their natural visual field.

Keywords:
auditory spatial perceptionmultisensory perceptionmultisensory spatial perceptionsensory substitutionsensory substitution device (SSD)spatial perceptionvisual-auditoryvisual-spatial perception

More Related Videos

A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.6K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.5K

Related Experiment Videos

Last Updated: Aug 6, 2025

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.2K
A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.6K
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.5K

Area of Science:

  • Neuroscience
  • Human-Computer Interaction
  • Sensory Augmentation

Background:

  • Technological advancements enable novel manipulation of sensory modalities.
  • Sensory substitution devices (SSDs) offer new ways to perceive information.
  • The EyeMusic algorithm converts visual data into auditory signals.

Purpose of the Study:

  • To investigate the potential of expanding natural senses using a visual-to-auditory SSD.
  • To assess sighted individuals' ability to integrate visual and auditory information for spatial awareness.
  • To explore the use of the EyeMusic for augmenting the visual field in sighted participants.

Main Methods:

  • Participants used the EyeMusic SSD to sonify visual information outside their natural field of view.
  • Tasks involved recognizing shapes and their spatial orientation (front/right/back/left) using combined visual and auditory input.
  • Training included a 1-hour online session and a 20-minute on-site session.

Main Results:

  • Participants successfully identified and located stimuli significantly above chance levels.
  • Subjects demonstrated the ability to generalize learning to new, untrained shapes.
  • Some participants could create 2D representations of the sonified visual information.

Conclusions:

  • Sensory augmentation devices can effectively expand perceptual fields when combined with natural sensory input.
  • This study provides a proof of concept for using SSDs to enhance sensory capabilities.
  • The findings suggest potential for integrating technology to augment human perception.