Vibrotactile identification of vowels

Area of Science:

• Auditory Neuroscience
• Human-Computer Interaction
• Haptics

Background:

• Vibrotactile displays translate auditory information into tactile sensations.
• Understanding speech through non-auditory channels is crucial for assistive technologies.

Purpose of the Study:

• To evaluate the effectiveness of two vibrotactile displays for vowel identification.
• To investigate the impact of display parameters on tactile speech perception.

Main Methods:

• Subjects identified vowels in consonant-vowel syllables presented via spectral and vocal tract area function displays on the Optacon transducer.
• Experiments varied the number of spectral channels, display size, and pattern type (filled vs. unfilled).
• The influence of multiple speakers and different display types was assessed.

Main Results:

• The spectral display effectively identified vowels, with performance dependent on the number of spectral channels.
• Reducing display size negatively impacted vowel identification, especially with filled spectral patterns.
• Multiple speakers increased response confusions due to variations in vocal tract resonances.
• The spectral display outperformed the vocal tract area function display.

Conclusions:

• A two-dimensional spectral display is a viable tactile display for speech perception.
• Further development of spectral vibrotactile displays for speech is warranted.
• Display size and pattern type are critical factors for effective tactile speech communication.