Related Experiment Video
Updated: Jun 13, 2025

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
Published on: September 27, 2024
Optimized feature gains explain and predict successes and failures of human selective listening
Ian M Griffith1,2,3, R Preston Hess1,2, Josh H McDermott1,2,3,4
1Department of Brain and Cognitive Sciences, MIT, Cambridge, MA, USA.
Abstract:
Attention facilitates communication by enabling selective listening to sound sources of interest. However, little is known about why attentional selection succeeds in some conditions but fails in others. While neurophysiology implicates multiplicative feature gains in selective attention, it is unclear whether such gains can explain real-world attention-driven behavior. To investigate these issues, we optimized an artificial neural network with stimulus-computable, feature-based gains to recognize a cued talker's speech from binaural audio in "cocktail party" scenarios. Though not trained to mimic humans, the model matched human performance across diverse real-world conditions, exhibiting selection based both on voice qualities and spatial location. It also predicted novel attentional effects that we confirmed in human experiments, and exhibited signatures of "late selection" like those seen in human auditory cortex. The results suggest that human-like attentional strategies naturally arise from optimization of feature gains for selective listening, offering a normative account of the mechanisms-and limitations-of auditory attention.
Related Concept Videos
Hindsight Biases
Stereotype Threat and Self-fulfilling Prophecies
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Attribution Theory
Cause and Effect
The Anchoring-and-Adjustment Heuristic

