声音事件的开放式集分类
Jie You1,2, Wenqin Wu2, Joonwhoan Lee3
1School of Information Engineering, East China Jiaotong University, Nanchang, 330013, China.
Scientific reports
|January 13, 2024
概括
这项研究引入了一种新的深度学习方法,用于开放式声音事件分类,增强识别未知的声音的能力. 通过优化特征空间,该方法显著提高了声音事件检测准确度.
科学领域:
- 机器学习 机器学习
- 音频信号处理 音频信号处理
- 人工智能的人工智能
背景情况:
- 声音事件分类对于理解音频环境至关重要.
- 传统方法在识别新鲜或未知的声音事件方面面临挑战.
- 深度学习为改进声音事件识别提供了潜力.
研究的目的:
- 开发一种改进的声音事件分类算法,能够识别未知的声音事件.
- 为了利用深度学习技术来增强音频感知.
- 探索自我监督学习在开放式声音事件检测中的有效性.
主要方法:
- 实施了包括中心损失和监督对比损失在内的深度学习模型.
- 优化了功能空间,为已知类创建紧的集群,为未知类创建充足的空间.
- 研究了自我监督学习用于检测未知的声音事件的应用.
主要成果:
- 拟议的开放式声音事件分类算法显示了显著的性能改进.
- 中心损失和对比损失的整合有效地减少了类内距离,并最大限度地提高了类间的分离.
- 自主监督学习方法在识别不同数据集中的未知声音事件方面也显示了持续的性能增长.
结论:
- 开发的深度学习框架为开放式声音事件分类提供了强大的解决方案.
- 中心损失,对比损失和自我监督学习的结合推进了音频事件检测领域.
- 这项研究有助于更准确,更全面的音频分析系统.
相关概念视频
Classification of Signals
466
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
466
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Hearing
52.3K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.3K
Classification of Systems-I
188
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
188
Perceiving Loudness, Pitch, and Location
214
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
214
Sound Waves
9.2K
Sound waves can be thought of as fluctuations in the pressure of a medium through which they propagate. Since the pressure also makes the medium's particles vibrate along its direction of motion, the waves can be modeled as the displacement of the medium's particles from their mean position.
Sound waves are longitudinal in most fluids because fluids cannot sustain any lateral pressure. In solids, however, shear forces help in propagating the disturbance in the lateral direction as well....
Sound waves are longitudinal in most fluids because fluids cannot sustain any lateral pressure. In solids, however, shear forces help in propagating the disturbance in the lateral direction as well....
9.2K


