Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Sensory Modalities01:15

Sensory Modalities

Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Auditory Pathway01:15

Auditory Pathway

Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Grand Challenges in Cross Reality.

IEEE transactions on visualization and computer graphics·2026
Same author

Mel frequency cepstral coefficient temporal feature integration for classifying squeak and rattle noise.

The Journal of the Acoustical Society of America·2021
Same author

Augmented situated visualization methods towards electromagnetic compatibility testing.

Computers & graphics·2020
Same author

Utilising reinforcement learning to develop strategies for driving auditory neural implants.

Journal of neural engineering·2016

Related Experiment Video

Updated: Jul 18, 2026

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
05:12

Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

Published on: September 18, 2017

546.0K

Exploring Audio Interfaces for Vertical Guidance in Augmented Reality via Hand-Based Feedback.

Renan Guarese, Emma Pretty, Aidan Renata

    IEEE Transactions on Visualization and Computer Graphics
    |March 4, 2024
    PubMed
    Summary

    Audio augmented reality (AR) can improve guidance tasks. Experiments show sonification methods not requiring pitch memorization offer better accuracy and lower workload for vertical guidance.

    More Related Videos

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.5K
    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
    07:46

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

    Published on: August 9, 2024

    724

    Related Experiment Videos

    Last Updated: Jul 18, 2026

    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
    05:12

    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

    Published on: September 18, 2017

    546.0K
    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.5K
    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility
    07:46

    Author Spotlight: Revolutionizing Remote Surgery with Augmented Reality and Robotics for Enhanced Precision and Accessibility

    Published on: August 9, 2024

    724

    Area of Science:

    • Human-Computer Interaction
    • Augmented Reality (AR)
    • Auditory Displays

    Background:

    • Assistive technologies for visually impaired individuals offer insights for broader audio interface applications.
    • Standardizing audio interfaces in AR is crucial for effective guidance tasks.
    • Sonification, the use of sound to convey information, is under-explored in AR guidance.

    Purpose of the Study:

    • To evaluate pitch-based sonification methods for vertical guidance in augmented reality (AR).
    • To assess the applicability of audio AR guidance for a general population beyond assistive technology contexts.
    • To identify sonification techniques that optimize accuracy and minimize user workload.

    Main Methods:

    • User experiments were conducted in real-life scenarios focusing on vertical guidance without visual feedback.
    • Hand-navigation assessments were used to test proposed sonification methods.
    • Feedback was incorporated from a digital accessibility expert with visual impairment.

    Main Results:

    • Sonification methods that did not require memorizing pitch demonstrated superior accuracy.
    • These methods also resulted in lower self-reported user workload.
    • User experiments (N=19) validated the effectiveness of selected audio AR guidance techniques.

    Conclusions:

    • Audio AR holds significant potential for enhancing user performance in various guidance scenarios.
    • Sonification methods avoiding pitch memorization are recommended for AR vertical guidance.
    • The findings support the broader application of audio AR in diverse fields, from gaming to object retrieval.