DuSAFNet:一种基于多路径特征融合和光谱-时间注意力的模型,用于鸟类音频分类
Zhengyang Lu1, Huan Li1, Min Liu1
1College of Information Engineering, Sichuan Agriculture University, Ya'an 625014, China.
Animals : an open access journal from MDPI
|August 14, 2025
概括
这项研究介绍了DuSAFNet,一个用于鸟类音频分类的轻量级深度神经网络. 它通过声音识别鸟类的高精度,有助于保护工作.
科学领域:
- 生物声学是一种生物声学.
- 机器学习 机器学习
- 计算生态学计算生态学
背景情况:
- 细粒度鸟类音频分类对于生物多样性监测至关重要.
- 现有的方法经常与复杂的光谱-时间模式作斗争,需要大量的计算资源.
- 自动声学监测为生态评估提供了一个可扩展的解决方案.
研究的目的:
- 开发一个轻量级的深度神经网络,DuSAFNet,用于准确的细粒度鸟类音频分类.
- 增强模型捕捉本地光谱纹理和远程时间依赖性的能力.
- 为了改善不同频段的类别间可分离性,以便进行可靠的分类.
主要方法:
- 双SAFNet采用双路特征融合和光谱时间注意力机制.
- 一个多频段的ArcMarginProduct分类器被用来提高类间的分离性.
- 该模型处理Mel光谱图,整合了本地和全球的光谱时间线索.
主要成果:
- 在18个物种的17653个记录数据集上,DuSAFNet实现了96.88%的准确性和96.83%的F1得分.
- 该模型表现出高效率,只有677万个参数和2.275个GFLOP.
- 对鸟类数据的交叉数据集评估得出了93.74%的准确率,表明了强烈的概括性.
结论:
- 杜萨夫网为鸟类音频分类提供了一种高性能,轻量级的解决方案.
- 其效率使其适合于边缘设备部署和实时预警,用于物种监测.
- 这项研究支持可扩展的自动声学监测,用于生物多样性评估和保护规划.
相关概念视频
01:30Classification of Signals
889
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
889
01:22Force Classification
1.6K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.6K
01:15Auditory Pathway
5.8K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.8K
01:17Auditory Perception
582
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
582
01:22Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
01:29Aggregates Classification
381
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
381