TweetyBERT:通过自我监督的机器学习来自动分析鸟歌
bioRxiv : the preprint server for biology
|April 28, 2025
概括
我们开发了TweetyBERT,这是一个自我监督的深度学习模型,用于分析没有人类标签的鸟歌. 这种人工智能方法自主识别动物发声中的通信单元,加速研究.
科学领域:
- 生物声学是一种生物声学.
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 目前对动物发声的分析依赖于人类标记的数据,这耗时且限制了可扩展性.
- 分析复杂的动物通信信号的无监督方法在生物声学中仍然是一个重大挑战.
研究的目的:
- 介绍TweetyBERT,一种新型的自我监督变压器神经网络,旨在无人监督地分析鸟.
- 展示TweetyBERT能够自主学习和识别动物发声中的通信单元的能力.
主要方法:
- 开发了TweetyBERT,一个转换器神经网络,利用自我监督的学习方法 (预测面具音频片段).
- 在没有人类提供的标签或监督的情况下,在金雀歌曲数据上训练有素的TweetyBERT.
- 应用该模型来分析鸟发声中的声学和时间模式.
主要成果:
- TweetyBERT成功地学会了从未标记的音频数据中识别鸟歌的独特行为单元,包括音符,音节和短语.
- 该模型自主地捕获了金丝雀歌曲中的复杂的声学和时间结构.
- 证明了自我监督学习在发现动物发声中的沟通模式方面的潜力.
结论:
- 像TweetyBERT这样的自我监督模型为分析大量未标记的动物发声数据提供了强大的解决方案.
- 这种方法通过消除手动数据注释的瓶,大大加快了对动物交流的研究.
- TweetyBERT代表了计算生物声学和动物声音的自动化分析的重大进步.
更多相关视频
相关概念视频
01:30Classification of Signals
314
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
314
00:54What is Behavior?
8.8K
Behaviors are actions that an organism engages in—they can be related to finding food, reproducing, defending against threats, and many other possible actions. Behaviors include activities related to the environment around the animal—such as migration—as well as social interactions within a species or population. Many behaviors involve motor output—that is, muscle movements—while others involve less visible actions, such as learning.
8.8K
01:22Force Classification
1.0K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.0K