Separation of speech from interfering sounds based on oscillatory correlation.
1Department of Computer and Information Science and Center for Cognitive Science, The Ohio State University, Columbus, OH 43210-1277, USA.
IEEE Transactions on Neural Networks
|February 7, 2008
Summary
This study introduces a neural model for auditory scene analysis, separating speech from noise using synchronized oscillators. The model enhances signal-to-noise ratio in mixed sounds, improving speech intelligibility.
Area of Science:
- Computational neuroscience
- Auditory perception
- Signal processing
Background:
- Auditory scene analysis is crucial for understanding complex acoustic environments.
- Segregating target sounds, like speech, from interfering noise is a significant challenge.
- Existing computational models face limitations in accurately mimicking human auditory perception.
Purpose of the Study:
- To propose a novel multistage neural model for auditory scene analysis.
- To effectively segregate speech from interfering sound sources.
- To evaluate the model's performance and compare it with existing methods.
Main Methods:
- A multistage neural model incorporating an auditory periphery model and mid-level representation formation.
- A core two-layer oscillator network performing stream segregation via oscillatory correlation.
- Representation of auditory streams through synchronized and desynchronized relaxation oscillator populations.
Main Results:
- The model demonstrated consistent improvements in signal-to-noise ratio across all tested speech and noise mixtures.
- Successful segregation of speech from interfering sounds was achieved.
- Performance was benchmarked against other computational auditory scene analysis studies.
Conclusions:
- The proposed neural model offers a promising approach to auditory scene analysis and speech segregation.
- Oscillatory correlation provides an effective mechanism for stream segregation in computational models.
- Further research is warranted for biological plausibility and real-time implementation.
Related Concept Videos
00:53Sound Waves: Interference
Sound waves can be modeled either as longitudinal waves, wherein the molecules of the medium oscillate around an equilibrium position, or as pressure waves. When two identical waves from the same source superimpose on each other, the combination of two crests or two troughs results in amplitude reinforcement known as constructive interference. If two identical waves, that are initially in phase, become out of phase because of different path lengths, the combination of crests with troughs...
01:10Interference: Path Lengths
Consider two sources of sound, that may or may not be in phase, emitting waves at a single frequency, and consider the frequencies to be the same.
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
Two special sources may be considered when they are in phase. This can be easily achieved by feeding the two sources from the same source. An example would be synchronizing the two speakers by feeding them with the same source, such as the sound waves produced by a tuning fork. This setup ensures that the two sources have the same frequency and are...
01:07Interference and Superposition of Waves
When two waves of the same nature occur in the same region simultaneously, they result in interference. Interference of waves implies that the net effect of the waves is the sum of the individual waves' effects. However, it does not imply that the individual waves affect the propagation of other waves.
Interference occurs in mechanical waves, such as sound waves, waves on a string, and surface water waves. Mechanical waves correspond to the physical displacement of particles. Hence,...
Interference occurs in mechanical waves, such as sound waves, waves on a string, and surface water waves. Mechanical waves correspond to the physical displacement of particles. Hence,...
02:18Interference and Diffraction
Interference is a characteristic phenomenon exhibited by waves. When two electromagnetic waves interact with their peaks and troughs coinciding, a resulting wave with enhanced amplitude is produced. This is known as constructive interference. In this case, the two waves interacting are in phase with each other.
01:08IR Spectrum Peak Splitting: Symmetric vs Asymmetric Vibrations
Identical bonds within a polyatomic group can stretch symmetrically (in-phase) or asymmetrically (out-of-phase). Similar to hydrogen bonding, these vibrations also influence the shape of the IR peak. Generally, asymmetric stretching frequencies are higher than symmetric stretching frequencies. For example, primary amines exhibit two distinct IR peaks between 3300–3500 cm−1 corresponding to the symmetric and asymmetric N-H stretching, while secondary amines exhibit a single stretching vibration...
01:01Perception of Sound Waves
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...