Related Experiment Video
Updated: Jan 10, 2026

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
Spectral peak picking improves tactile speech perception
Mark D Fletcher1,2,3, Carl A Verschuur4,5, Esma Akis6,5
1Faculty of Medicine, University of Southampton, University Road, Southampton, SO17 1BJ, UK. M.D.Fletcher@soton.ac.uk.
None:
Individual differences in speech perception often arise from disparities in access to acoustic-phonetic cues, particularly among those with hearing loss. Haptic hearing aids, which convey speech information through the sense of touch, offer a complementary pathway to improve speech understanding. However, effectively transmitting critical speech features through vibrotactile stimulation remains challenging.To address this challenge, we introduce a tactile spectral peak picking (tSPP) approach, integrated into a vocoder-based audio-to-tactile conversion algorithm to enhance vibrotactile phoneme discrimination. The tactile vocoder decomposes audio into eight frequency bands, with tSPP selectively transmitting only the most energetic bands to emphasise dominant spectral features.Tactile phoneme discrimination on the wrist was tested in 26 participants using either the tactile vocoder alone or with the tSPP algorithm selecting one, two, or four peaks. Discrimination improved significantly when one, two, or four peaks were selected relative to the vocoder alone, with the greatest benefits observed for one- and two-peak tSPP (average improvement: 7.5%).These findings demonstrate that selective enhancement of spectrally salient features can improve tactile speech perception. The algorithm is suitable for real-time use in wearable sensory substitution devices and could aid the development of effective haptic hearing aids.
Related Concept Videos
Auditory Perception
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
Design Example
Tactile and Chemical Senses
IR Spectrum Peak Splitting: Symmetric vs Asymmetric Vibrations

