在自我监督学习中发现了代数听觉结构
Pierre Orhan1, Yves Boubenec1, Jean-Rémi King1,2
1Laboratoire des Systèmes Perceptifs, Département d'études Cognitives, École Normale Supérieure, PSL University, CNRS, Paris, France.
PLoS computational biology
|September 5, 2025
概括
深度学习模型表明,仅仅接触自然声音可以在听觉处理中自发检测复杂的代数结构. 这种能力是通过音乐和环境声音增强的,
科学领域:
- 认知科学
- 计算神经科学
- 人工智能
背景情况:
- 人们自发地发现代数结构,
- 这种能力的天生机制与基于经验的学习之间存在争议.
- 这些理论的实验测试具有挑战性.
研究的目的:
- 通过深度学习来评估驱动自发代数结构检测的因素.
- 模拟不同声音刺激 (自然,环境,语音,音乐) 对这种能力的影响.
- 提供一个操作框架来理解先天与已知的原则.
主要方法:
- 使用自我监督学习来训练深度学习模型.
- 训练有素的模型使用不同的自然,环境,语音和音乐声音.
- 暴露训练模型用于代数结构处理的标准实验范式.
主要成果:
- 模型自发地检测出序列,块和复杂的结构,
- 随着结构复杂性的增加,检测能力下降.
- 仅仅是自然声音的体验促进了结构的检测;音乐比环境声音更能加速它.
- 仅仅在语言上进行预训练并不能产生这种能力.
结论:
- 自发的代数结构检测可以从听觉输入的经验中出现.
- 环境和文化声音对这种认知能力的发展有很大影响.
- 深度学习模型提供了一个可行的框架来剖析听觉结构处理等认知能力.
更多相关视频
05:48Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
Published on: August 9, 2024
1.6K
08:45Mapping Cortical Dynamics Using Simultaneous MEG/EEG and Anatomically-constrained Minimum-norm Estimates: an Auditory Attention Example
Published on: October 24, 2012
14.8K
相关概念视频
Hearing
53.0K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
53.0K
Auditory Pathway
5.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.8K
Auditory Perception
579
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
579
Perceiving Loudness, Pitch, and Location
419
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
419
Classification of Signals
875
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
875
