Auris System: Providing Vibrotactile Feedback for Hearing Impaired Population

Area of Science:

• Neuroscience
• Human-Computer Interaction
• Music Technology

Background:

• Millions globally experience deafness, impacting social participation, especially in music-centered events.
• Existing music accessibility solutions for the deaf are limited.
• Understanding human musical cognition is crucial for developing inclusive technologies.

Purpose of the Study:

• To introduce the Auris System, designed to enable musical experimentation for individuals with hearing loss.
• To create a novel media format translating musical information into non-auditory stimuli.
• To establish a testing methodology for evaluating the system's effectiveness and understanding musical cognition.

Main Methods:

• Developing the Auris System to extract musical data from audio.
• Creating multi-sensory representations of music.
• Implementing a testing protocol using noninvasive electroencephalographic (EEG) recordings.
• Analyzing brain activity to assess musical perception and cognition.

Main Results:

• The Auris System successfully translates musical information into alternative sensory outputs.
• The EEG-based methodology provides insights into brain responses to the generated stimuli.
• Initial findings contribute to a better understanding of auditory processing and musical cognition in hearing-impaired individuals.

Conclusions:

• The Auris System offers a novel pathway for deaf individuals to engage with music.
• EEG data analysis aids in refining the system's accuracy and effectiveness.
• This research advances inclusive music technology and the study of auditory cognition.