Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

59.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
59.0K
Auditory Perception01:17

Auditory Perception

1.5K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.5K
Auditory Pathway01:15

Auditory Pathway

9.0K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
9.0K
Perception of Sound Waves01:01

Perception of Sound Waves

6.1K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
6.1K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

1.3K
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
1.3K
Visual System01:26

Visual System

2.3K
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
2.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

NavGraph: Enhancing Blind Travelers' Navigation Experience and Safety.

Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies·2025
Same author

Enhancing Walk-Light Detector Usage for the Visually Impaired: A Comparison of VR Exploration and Verbal Instructions.

... International web for all conference. Web for All Conference·2025
Same author

MapIO: A Gestural and Conversational Interface for Tactile Maps.

IEEE access : practical innovations, open solutions·2025
Same author

Systematically Evaluating Digital Map Tools Based on the WCAG.

Journal on technology and persons with disabilities : ... Annual International Technology and Persons with Disabilities Conference·2025
Same author

Designing Born-Accessible Courses in Data Science and Visualization: Challenges and Opportunities of a Remote Curriculum Taught by Blind Instructors to Blind Students.

Eurographics/IEEE VGTC Symposium on Visualization : EUROVIS : [proceedings]. Eurographics/IEEE VGTC Symposium on Visualization·2025
Same authorSame journal

Accessible Point-and-Tap Interaction for Acquiring Detailed Information about Tactile Graphics and 3D Models.

Computers helping people with special needs : ... International Conference, ICCHP ... : proceedings. International Conference on Computers Helping People with Special Needs·2024

Related Experiment Video

Updated: Apr 11, 2026

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

10.9K

An Investigation Into Incorporating Visual Information in Audio Processing.

Ender Tekin, James M Coughlan, Helen J Simon

    Computers Helping People with Special Needs : ... International Conference, ICCHP ... : Proceedings. International Conference on Computers Helping People with Special Needs
    |June 2, 2015
    PubMed
    Summary

    Integrating visual cues into hearing aids can improve speech understanding for individuals with hearing loss, especially in noisy environments. This technology offers significant benefits for those with combined hearing and vision impairments.

    More Related Videos

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
    09:01

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

    Published on: March 27, 2013

    15.1K
    Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
    05:38

    Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

    Published on: June 29, 2021

    3.0K

    Related Experiment Videos

    Last Updated: Apr 11, 2026

    Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
    09:27

    Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

    Published on: October 13, 2018

    10.9K
    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
    09:01

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

    Published on: March 27, 2013

    15.1K
    Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
    05:38

    Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology

    Published on: June 29, 2021

    3.0K

    Area of Science:

    • Audiology and assistive technology
    • Human-computer interaction
    • Sensory substitution

    Background:

    • Increasing lifespans lead to a rise in individuals with hearing and vision loss.
    • Vision is crucial for communication, particularly in noisy settings or for those with hearing deficits.
    • Individuals with vision loss cannot leverage visual cues to compensate for hearing impairments.

    Purpose of the Study:

    • To explore the integration of visual information into hearing aids using a wearable camera.
    • To assess the potential benefits of visual cues for individuals with hearing loss, especially in high background noise.
    • To evaluate the impact on speech perception for individuals with dual sensory loss.

    Main Methods:

    • Development of a hearing aid system incorporating a small, wearable camera.
    • Automatic extraction of low-level visual cues from the camera feed.
    • Testing speech perception performance in varying background noise conditions.
    • Comparison of performance with and without integrated visual cues.

    Main Results:

    • Initial results indicate significant benefits from incorporating visual cues, particularly in high background noise.
    • The proposed technique shows potential for widespread benefit across the hearing loss population.
    • Substantial improvements in speech perception were observed for individuals with dual sensory loss.

    Conclusions:

    • Automatically utilizing visual information in hearing aids is a promising approach to enhance communication.
    • This technology can improve speech perception for individuals with hearing loss, especially in challenging acoustic environments.
    • The system offers significant potential for individuals with combined hearing and vision loss, addressing a critical unmet need.