Related Experiment Video
Updated: Jun 19, 2026

11:39
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022
From Keystrokes to Auditory Textures: Structural Acoustic Analysis of an Emergent Haptic Soundscape
IEEE Transactions on Haptics
|June 17, 2026
Summary
This study analyzed the acoustic output of a keyboard installation to understand environmental haptics. High-density settings mimic natural water sounds, revealing emergent acoustic textures from distributed mechanical systems.
Area of Science:
- Acoustic analysis
- Haptic phenomena
- Sound installation art
Background:
- Haptics research often focuses on individual, direct-contact interfaces.
- Environmental haptic phenomena are understudied due to measurement challenges in public spaces.
- The "Babbling Brook" installation uses 40 solenoid-actuated keyboards to explore distributed haptics.
Purpose of the Study:
- To analyze emergent haptic phenomena in a large-scale sound installation.
- To use acoustic analysis as a proxy for difficult-to-measure haptic transformations.
- To investigate how mechanical profiles of keyboards influence acoustic texture.
Main Methods:
- Structural acoustic analysis of the "Babbling Brook" installation.
- Digital Signal Processing (DSP) metrics (envelope smoothness variance, spectral flux, etc.) applied to audio recordings.
- Comparison of keyboard textures across four density modes and with natural water recordings.
Main Results:
- Four of seven acoustic metrics showed significant differences across installation modes ($p < 0.035$).
- Keyboard-specific acoustic profiles converged at high densities, approaching Gaussian waveform statistics.
- High-density installation sounds overlapped natural water sounds on five metrics, indicating a broadband stationary regime.
Conclusions:
- Quantitative acoustic data support the concept of emergent environmental haptics from distributed systems in art.
- The installation successfully simulates naturalistic sound textures, approaching but not fully replicating natural water sounds.
- Future work should include direct vibrotactile measurement and perceptual validation.
Related Concept Videos
Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Sound as Pressure Waves
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
