Related Experiment Video
Updated: Dec 28, 2025

11:39
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
2.5K
EarVR: Using Ear Haptics in Virtual Reality for Deaf and Hard-of-Hearing People
IEEE Transactions on Visualization and Computer Graphics
|February 20, 2020
Summary
Deaf and Hard-of-Hearing (DHH) individuals can now better utilize virtual reality (VR) with EarVR. This device enhances 3D sound localization, significantly improving task completion times and VR engagement for DHH users.
Area of Science:
- Human-Computer Interaction
- Assistive Technology
- Virtual Reality
Background:
- Virtual Reality (VR) offers significant potential for skill development in Deaf and Hard-of-Hearing (DHH) individuals.
- Current VR applications and hardware present limitations for DHH users due to a lack of auditory accessibility features.
Purpose of the Study:
- To introduce and evaluate EarVR, a novel prototype designed to enhance VR accessibility for DHH individuals.
- To assess EarVR's effectiveness in improving DHH users' ability to interact with 3D sound in VR environments.
Main Methods:
- EarVR is a mountable prototype for VR Head-Mounted Displays (HMDs) that analyzes 3D sounds and provides directional cues via vibro-motors.
- User studies compared task completion times and success rates for DHH participants with and without EarVR, alongside non-DHH participants.
Main Results:
- DHH participants using EarVR completed simple VR tasks significantly faster than those without the device, achieving times comparable to non-DHH users.
- EarVR enabled DHH participants to successfully complete complex VR tasks that were previously impossible without the device.
Conclusions:
- EarVR effectively bridges the accessibility gap in VR for DHH individuals by providing crucial auditory cues.
- The prototype enhances VR task performance and user experience, encouraging greater adoption of VR technology among the DHH community.
Related Concept Videos
Hearing
56.2K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
56.2K
Anatomy of the Ear
10.9K
Auditory sensation, commonly called hearing, involves the transformation of sonic waves into neural impulses facilitated by the structures of the auditory organ. The prominent, flesh-like structure on the side of the head, called the auricle, directs sound waves towards the auditory canal. The auricle is often mislabeled as the pinna, a term more aligned with mobile structures like a feline's external ear. The auditory canal penetrates the cranium via the external auditory meatus of the...
10.9K
Auditory Perception
926
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
926
Perceiving Loudness, Pitch, and Location
844
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
844
Hair Cells
44.1K
Hair cells are the sensory receptors of the auditory system—they transduce mechanical sound waves into electrical energy that the nervous system can understand. Hair cells are located in the organ of Corti within the cochlea of the inner ear, between the basilar and tectorial membranes. The actual sensory receptors are called inner hair cells. The outer hair cells serve other functions, such as sound amplification in the cochlea, and are not discussed in detail here.
44.1K
Auditory Pathway
6.9K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
6.9K

