使用时间记忆进行Q学习,以导航流
Marco Rando1, Martin James2, Alessandro Verri1
1MaLGa, Department of Computer Science, Bioengineering, Robotics and Systems Engineering, University of Genova, Genoa, Italy.
eLife
|July 21, 2025
概括
这项研究表明,在动荡的环境中,代理人可以学会只使用嗅觉来导航. 通过使用时间记忆和强化学习算法,特工通过学习最佳的气味导向策略,成功地找到目标.
科学领域:
- 机器人和人工智能 机器人和人工智能
- 动物行为和感官生态学
背景情况:
- 在动荡的环境中导航的代理人通常依赖于嗅觉线索.
- 缺乏空间感知使得学习策略只需从气味刺激中学习.
研究的目的:
- 通过使用顺序决策来调查代理人是否可以在动荡的环境中学习强大的嗅觉导航.
- 开发和测试一种用于气味导航的强化学习算法.
主要方法:
- 开发了一种强化学习算法,具有可解释的嗅觉状态和时间记忆.
- 训练有素的特工使用现实的流气味线索.
- 分析了基于气味羽毛特征和学习策略的药剂性能.
主要成果:
- 代理人学会了有效地使用离散的嗅觉状态和时间记忆来导航.
- 确定了一种最佳的记忆策略,平衡羽毛状物检测和恢复.
- 学习的恢复策略涉及横风造,模仿昆虫的行为.
结论:
- 两个关键的嗅觉痕迹特征足以在现实的气味羽毛中学习导航.
- 学习的策略对环境变化具有坚固性,这表明了适应能力.
- 强化学习为开发自主嗅觉搜索代理提供了可行的框架.
更多相关视频
相关概念视频
Turbulent Flow: Problem Solving
181
Carbonation is a process used to dissolve carbon dioxide gas in a liquid, commonly used in the production of carbonated beverages. Achieving efficient carbonation requires careful control of temperature, pressure, and flow conditions. By adjusting these parameters, carbonation efficiency can be maximized, producing a higher concentration of CO2 in the liquid.
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures...
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures...
181
Observational Learning
305
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
305
Laminar Flow: Problem Solving
249
Laminar flow occurs when a fluid moves smoothly in parallel layers with minimal mixing and turbulence. In fluid mechanics, ensuring laminar flow within a pipe is essential for precise control of flow characteristics, especially in engineering applications. The key factor in determining whether flow remains laminar is the Reynolds number, a dimensionless quantity that depends on the fluid's velocity, density, viscosity, and the pipe's diameter. A Reynolds number of 2100 or lower...
249
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K
Uniform Depth Channel Flow: Problem Solving
124
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
124
Associative Learning
566
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
566


