EyeMusic: Introducing a "visual" colorful experience for the blind using auditory sensory substitution
Sami Abboud1, Shlomi Hanassy1, Shelly Levy-Tzedek2
1Department of Medical Neurobiology, The Institute for Medical Research Israel-Canada, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel.
Restorative Neurology and Neuroscience
|January 9, 2014
Summary
The novel EyeMusic device offers a pleasant auditory experience for the blind, enabling them to perceive shape and color information through musical notes after minimal training.
Area of Science:
- Neuroscience
- Biomedical Engineering
- Human-Computer Interaction
Background:
- Sensory-substitution devices (SSDs) translate visual data into auditory or tactile signals.
- Existing SSDs often produce unpleasant sensations and lack color representation.
Purpose of the Study:
- To introduce EyeMusic, a novel visual-to-auditory SSD designed for the blind.
- To address limitations of current SSDs by incorporating shape and color information with pleasant auditory stimuli.
Main Methods:
- Developed EyeMusic, utilizing musical notes on a pentatonic scale for visual data representation.
- Employed a training protocol to enable users to extract shape and color information.
- Assessed stimulus pleasantness through surveys and comparison tasks.
Main Results:
- Demonstrated successful decoding of basic shape and color information from auditory stimuli.
- Achieved high performance levels with participants after only 2-3 hours of training.
- Found that users perceived the auditory stimuli as pleasant and potentially tolerable for extended use.
Conclusions:
- The EyeMusic algorithm offers an intuitive and pleasant method for the blind to perceive shape and color.
- This technology may aid in visual rehabilitation by providing enhanced functionality and user experience.
Related Concept Videos
01:15Sensory Modalities
4.1K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
4.1K
01:27Synesthesia
1.0K
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
1.0K
02:07Blind Procedures
10.8K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.8K
00:50Unrenewable Cells
2.1K
In humans, the photoreceptor cells of the eye and sensory hair cells of the ear lack stem cells. These cells are thus unrenewable and cannot be replaced when they are damaged or destroyed.
Photoreceptors
The retina is composed of several layers and contains specialized cells called photoreceptors. The photoreceptors (rods and cones) change their membrane potential when stimulated by light energy. There are two types of photoreceptors—rods and cones—which differ in the shape of...
Photoreceptors
The retina is composed of several layers and contains specialized cells called photoreceptors. The photoreceptors (rods and cones) change their membrane potential when stimulated by light energy. There are two types of photoreceptors—rods and cones—which differ in the shape of...
2.1K
01:26Introduction to Special Senses
6.7K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
6.7K
01:15Auditory Pathway
7.1K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
7.1K