Related Experiment Video
Updated: Jul 15, 2026
05:48
Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
Published on: August 9, 2024
Learning to perceive with a visuo-auditory substitution system: localisation and object recognition with 'the vOICe'.
Malika Auvray1, Sylvain Hanneton, J Kevin O'Regan
1Department of Experimental Psychology, University of Oxford, South Parks Road, Oxford OX1 3UD, UK. malika@malika-auvray.com
Perception
|April 26, 2007
Summary
Participants mastered the auditory-substitution-of-vision device (The vOICe) for navigation and object recognition. Sensorimotor interaction with the device enabled immediate spatial and perceptual understanding, enhancing user experience.
Area of Science:
- Neuroscience
- Human-Computer Interaction
- Sensory Substitution
Background:
- Sensory substitution devices offer alternative sensory input for individuals with sensory impairments.
- The vOICe system translates visual information into auditory signals.
- Mastering such devices requires extensive training and adaptation.
Purpose of the Study:
- To assess the extent to which participants could master The vOICe device.
- To evaluate performance in dynamic 3D tasks including locomotion, localization, and object recognition.
- To explore subjective user experiences and strategies for device mastery.
Main Methods:
- Participants underwent extensive training with The vOICe device.
- Four experiments assessed locomotion, localization, object recognition, and discrimination in a 3D environment.
- Objective performance metrics and subjective user feedback were analyzed.
Main Results:
- Participants successfully utilized The vOICe for locomotor guidance, localization, and pointing.
- Auditory stimulation facilitated object recognition and discrimination.
- Sensorimotor interactions with the device were crucial for information acquisition.
Conclusions:
- Mastery of The vOICe enables effective navigation and object perception through auditory substitution.
- Users develop immediate apprehension of the environment, moving beyond deductive reasoning.
- The device holds significant potential for enhancing the capabilities of visually impaired individuals.
More Related Videos
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:26Visual System
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...