Related Experiment Videos
Coding of acoustic features for a single-channel tactile aid
I R Summers1, P Milnes, J C Stevens
1Department of Physics, University of Exeter.
British Journal of Audiology
|August 1, 1996
Summary
Tactile speech perception using vibrotactile signals showed that single features, particularly zero-crossing frequency for consonants and fundamental frequency (F0) for stress, performed best. This research informs wearable device design for auditory substitution.
Area of Science:
- Auditory Neuroscience
- Human-Computer Interaction
- Biomedical Engineering
Background:
- Vibrotactile stimulation offers a potential channel for auditory substitution.
- Encoding speech information into tactile signals requires careful consideration of signal processing and feature extraction.
Purpose of the Study:
- To investigate the effectiveness of different speech-derived signals for tactile discrimination.
- To compare single-feature versus two-feature tactile coding strategies for speech perception.
- To inform the design of wearable vibrotactile devices for communication.
Main Methods:
- Speech signals (amplitude envelope, fundamental frequency (F0), zero-crossing frequency) were coded into amplitude- and frequency-modulated pulse trains.
- Single-channel vibrotactile stimulation was applied to the index fingertip.
- Participants performed discrimination tasks for speech contrasts, including consonants and emphatic stress.
Main Results:
- Single-feature coding was as effective as two-feature coding for tactile speech perception.
- Zero-crossing frequency coding yielded the highest consonant discrimination scores.
- Fundamental frequency (F0) coding resulted in the best emphatic-stress discrimination and overall performance.
Conclusions:
- Single-feature tactile coding of specific speech parameters is effective for conveying speech information.
- Zero-crossing frequency and fundamental frequency (F0) are promising features for tactile speech displays.
- Experimental findings support the development of practical vibrotactile devices for auditory substitution.