The sentiphone: a tactual speech communication aid

Area of Science:

• Audiology
• Assistive Technology
• Speech Science

Background:

• Speechreading (lipreading) is a challenging visual task for individuals with hearing loss.
• Existing assistive technologies often lack optimal complementary sensory input.
• Tactual perception offers a potentially powerful alternative or supplement to visual information for speech understanding.

Purpose of the Study:

• To develop guiding principles for a speechreading aid.
• To investigate the efficacy of tactually presented phonetic features.
• To evaluate the combined use of visual and tactual speech information.

Main Methods:

• Development of a speechreading aid presenting phonetic features via vibratory frequency and intensity.
• Evaluation of speech feature visibility.
• Experimental testing of word recognition (visual, tactual, combined).
• Assessment of tactual phoneme recognition.

Main Results:

• The device effectively displays phonetic features through tactile stimuli.
• Combined visual and tactual input significantly improved word recognition compared to visual-only or tactual-only methods.
• Tactual phoneme recognition demonstrated the potential of vibrotactile feedback.

Conclusions:

• Optimal complementary tactile information can significantly enhance speechreading.
• Tactual discriminability is a key factor in designing effective speech communication aids.
• This technology holds promise for improving auditory rehabilitation for the deaf.