Jove
Visualize
Contact Us

Related Concept Videos

Auditory Perception01:17

Auditory Perception

1.3K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.3K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.2K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.2K
Perception of Sound Waves01:01

Perception of Sound Waves

5.8K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.8K
Hearing01:31

Hearing

57.9K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
57.9K
Auditory Pathway01:15

Auditory Pathway

7.7K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.7K
Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

2.3K
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
2.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Generating accurate 3D gaze vectors using synchronized eye tracking and motion capture.

Behavior research methods·2022
Same author

Human EEG and Recurrent Neural Networks Exhibit Common Temporal Dynamics During Speech Recognition.

Frontiers in systems neuroscience·2021
Same author

Brain electrical dynamics in speech segmentation depends upon prior experience with the language.

Brain and language·2021
Same author

Speech Interaction to Control a Hands-Free Delivery Robot for High-Risk Health Care Scenarios.

Frontiers in robotics and AI·2021
Same author

Phase of electroencephalography theta oscillation during stimulus encoding affects accuracy of memory recall.

Neuroreport·2019
Same author

The effects of distractor set-size on neural tracking of attended speech.

Brain and language·2019
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Feb 25, 2026

Photorealistic Learned Landscapes for Augmented Reality
06:54

Photorealistic Learned Landscapes for Augmented Reality

Published on: June 27, 2025

803

Rendering visual events as sounds: Spatial attention capture by auditory augmented reality.

Scott A Stone1, Matthew S Tata1

  • 1Department of Neuroscience, Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Alberta, Canada.

Plos One
|August 10, 2017
PubMed
Summary

This study developed a system using a neuromorphic camera to convert visual events into sound. The technology successfully detects objects and visual motion direction for blindfolded users.

More Related Videos

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

15.0K
Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.7K

Related Experiment Videos

Last Updated: Feb 25, 2026

Photorealistic Learned Landscapes for Augmented Reality
06:54

Photorealistic Learned Landscapes for Augmented Reality

Published on: June 27, 2025

803
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

15.0K
Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios
06:02

Evaluating Usability Aspects of a Mixed Reality Solution for Immersive Analytics in Industry 4.0 Scenarios

Published on: October 6, 2020

2.7K

Area of Science:

  • Neuroscience
  • Computer Vision
  • Sensory Augmentation

Background:

  • Visual and auditory information often coincide, aiding perception and spatial tasks.
  • Not all visual stimuli have corresponding auditory events, limiting sensory integration.
  • Augmenting visual events into auditory signals can enhance spatial awareness.

Purpose of the Study:

  • To develop a system for detecting salient visual events and transforming them into localizable auditory events.
  • To assess the system's efficacy in object detection and motion direction determination for blindfolded users.

Main Methods:

  • Utilized a neuromorphic camera (DAVIS 240B) to detect logarithmic changes in brightness intensity, signifying salient visual events.
  • Developed a system to translate these visual events into auditory signals.
  • Conducted user studies with blindfolded participants to evaluate object detection and motion tracking capabilities.

Main Results:

  • The system demonstrated robustness in detecting novel salient stimuli.
  • Accurate encoding of visual motion direction was achieved.
  • Participants could effectively use the auditory feedback for spatial awareness tasks.

Conclusions:

  • The developed system successfully augments visual events into localizable auditory signals.
  • Neuromorphic camera technology shows promise for enhancing sensory perception and spatial tasks.
  • Future advancements in neuromorphic devices will likely increase the feasibility and performance of such systems.