Relative-pitch tracking of multiple arbitrary sounds

Paris Smaragdis1

  • 1Adobe Systems Inc., 275 Grove Street, Newton, Massachusetts 02466, USA. paris@adobe.com

Summary

This study introduces a probabilistic method for tracking perceived pitch in complex sounds, including multiple sources and aperiodic signals. The approach demonstrates robust performance on real recordings, offering a novel alternative to traditional pitch tracking techniques.

Related Concept Videos

Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Sound as Pressure Waves01:17

Sound as Pressure Waves

Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
Doppler Effect - II01:05

Doppler Effect - II

The Doppler effect has several practical, real-world applications. For instance, meteorologists use Doppler radars to interpret weather events based on the Doppler effect. Typically, a transmitter emits radio waves at a specific frequency toward the sky from a weather station. The radio waves bounce off the clouds and precipitation and travel back to the weather station. The radio frequency of the waves reflected back to the station appears to decrease if the clouds or precipitation are moving...
Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Relative Motion Analysis using Rotating Axes01:25

Relative Motion Analysis using Rotating Axes

Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...