通过内在的奖励来学习复杂的声乐技能的声音库存
Hazem Toutounji1,2,3, Anja T Zai4,5, Ofer Tchernichovski6
1Department of Psychology, University of Sheffield, Sheffield S1 4DP, UK.
Science advances
|March 27, 2024
概括
一种新的竞争合作型多行为体强化学习 (MARL) 模型准确地解释了幼鸟如何学习复杂的发音. 这种方法,与标准模型不同,可以有效地获取鸟类歌声和演讲中的丰富声音谱.
科学领域:
- 神经科学是一个神经科学.
- 计算生物学 计算生物学
- 动物行为 动物行为
背景情况:
- 强化学习 (RL) 被假设为驱动声乐技能的获取,例如鸟和人类言语.
- 标准的演员-批评RL模型很难解释斑马等物种观察到的各种声乐谱的高效学习.
研究的目的:
- 调查复杂的声乐谱的获取基础上的强化学习策略.
- 开发和测试一个计算模型,准确地复制幼鸟的经验学习轨迹.
主要方法:
- 开发了一种新的竞争合作多行为体强化学习 (MARL) 算法.
- 马尔模型被用来模拟幼斑马的学习过程,即获得多个音节.
- 模型预测与经验学习数据进行了比较.
主要成果:
- 标准的演员-批评模型无法解释青少年斑马的多个音节的高效学习.
- 提出的MARL模型,包括多个独立的参与者共同最大化共同的奖励,准确地重现了鸟类的学习轨迹.
- 参与者对全球奖励的影响是由与目标音节的声学相似性决定的,导致目标匹配和偶尔的竞争排除.
结论:
- 竞争合作的MARL算法对于有效地学习复杂技能的行动清单至关重要.
- 这一框架为发声学习中丰富的声音谱的发展提供了更准确的解释.
- 这些发现对理解动物声学学习和人工智能发展都有影响.
相关概念视频
Purposive Learning
119
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
119
Observational Learning
170
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
170
Auditory Perception
338
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
338
Hearing
52.1K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.1K
Elaborative Rehearsals
86
Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...
The effectiveness of...
86
Reinforcement
204
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
204


