Perceptual Adaptation to Noise-Vocoded Voice Clones
Han Wang1,2,3, Carolyn McGettigan4, Patti Adank4
1School of Psychology, University of Roehampton, London, UK.
Trends in Hearing
|July 18, 2026
Summary
Voice clones remain more intelligible than human voices even when degraded by noise-vocoding. Listeners adapt to cloned voices as effectively as human voices, showing significant intelligibility improvements.
Area of Science:
- Speech processing
- Artificial intelligence
- Psychoacoustics
Background:
- Voice cloning technology produces humanlike synthetic voices.
- Cloned voices show enhanced intelligibility over human voices in background noise.
- Noise-vocoding severely degrades speech signal information.
Purpose of the Study:
- To determine if voice clones maintain intelligibility benefits when degraded by noise-vocoding.
- To investigate listener adaptation to noise-vocoded voice clones.
- To compare adaptation to noise-vocoded cloned versus human voices.
Main Methods:
- Ten six-band noise-vocoded voice clones and their human originals were compared.
- Listeners heard 80 sentences in counterbalanced blocks of cloned and human voices.
- Intelligibility accuracy and perceptual adaptation over time were measured.
Main Results:
- Voice clones demonstrated 13.2% higher intelligibility accuracy than human originals.
- Listeners adapted to noise-vocoded speech, improving by approximately 16%.
- Adaptation levels were similar for both noise-vocoded cloned and human voices.
Conclusions:
- The intelligibility benefit of voice clones persists with noise-vocoded speech.
- Listeners perceptually adapt to noise-vocoded cloned voices effectively.
- Findings support voice clone applications, including assistive listening technologies.
Related Concept Videos
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:12Perceptual Constancy
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
01:14Impression Management Techniques IV: Altercasting
Altercasting is a strategic communication technique in which an individual imposes a specific identity or social role onto another person to influence their behavior and shape the interaction. By presuming a role—such as “responsible leader” or “patient person”—altercasting encourages the target to conform to that identity, often aligning their behavior with the expectations associated with the role. The power of this tactic lies in its subtlety; once a role is assigned, it becomes socially...
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.