Audio large language models align with human neural responses during spoken-language comprehension

Shiyao Zhu1, Ao Chen2, Yanlu Xie1

  • 1School of Information Science and Technology, Beijing Language and Culture University, 15 Xueyuan Road, Haidian District, Beijing 100083, China; Key Laboratory of the Cognitive Science of Language (Ministry of Education), Beijing Language and Culture University, 15 Xueyuan Road, Haidian District, Beijing 100083, China.

Neuroimage
|November 10, 2026
PubMed

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Perceiving Language Sounds and Structure During Infancy01:20

Perceiving Language Sounds and Structure During Infancy

Infants are born with a predisposition to perceive and categorize basic linguistic sounds. Early in development, they can discriminate sounds from many languages and detect differences in rhythm and pattern. This sensitivity may begin before birth. Newborns exposed to two languages prenatally can recognize both, indicating that fetal language exposure influences later auditory discrimination.Recognition of Familiar SoundsBy five months, infants show preferences for familiar auditory stimuli,...
Hearing01:31

Hearing

When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Hearing During Infancy and Toddlerhood01:29

Hearing During Infancy and Toddlerhood

Hearing begins developing before birth. Fetuses respond to sounds in the womb through changes in brain activity, heart rate, and body movements, showing sensitivity to auditory stimulation. After birth, hearing continues to develop rapidly, supporting language learning and environmental awareness.Auditory Acuity and Sound LocalizationAuditory acuity refers to the ability to detect sounds. Newborns are especially responsive to human voices and can detect many speech sounds, although their...