Translating Music to Touch: Exploring Tactile Perception of Pitch, Roughness, and Pleasantness.

Area of Science:

• Auditory Neuroscience
• Haptics
• Human-Computer Interaction

Background:

• Music is a multisensory experience, but hearing impairments limit access.
• Advancing tactile technologies raise possibilities for conveying music via vibration.

Purpose of the Study:

• Investigate translating core auditory music perception dimensions (pitch, roughness, pleasantness) into the tactile domain.
• Explore the potential of vibrotactile displays for music accessibility.

Main Methods:

• Participants rated tactile perception of sinusoidal and complex waveforms (40-750 Hz).
• Stimuli included amplitude modulated, sawtooth, and missing fundamental waveforms.
• Perceptual dimensions assessed were pitch, roughness, and pleasantness.

Main Results:

• Tactile pitch perception showed a systematic relationship with stimulus frequency.
• Sawtooth waveforms effectively represented pitch changes, highlighting temporal transitions.
• Roughness negatively correlated with pleasantness, and abrupt temporal changes reduced pleasantness.
• Tactile perception relied on the temporal envelope, not fine structure, evidenced by a missing fundamental phenomenon analog.

Conclusions:

• Vibrotactile displays can potentially convey simple melodic patterns and music-related perceptual dimensions.
• Tactile pitch perception relies on envelope periodicity, similar to auditory perception.
• Findings inform the design of vibrotactile systems for music accessibility, though further testing in hearing-impaired individuals is needed.