学习在复杂的珊瑚礁环境中避开障碍和捕食,使用深度强化学习学习
Ji Hou1,2, Changling He1,2, Tao Li1,2
1Southwest Research Institute for Hydraulic and Water Transport Engineering, Chongqing Jiaotong University, Chongqing 402247, People's Republic of China.
Bioinspiration & biomimetics
|July 18, 2024
概括
这项研究模拟了鱼类在复杂的珊瑚礁环境中使用深度强化学习来导航. 这些发现揭示了鱼类如何在动态的水流中适应它们的捕食策略,从而增强了我们对水生行为的理解.
科学领域:
- 海洋生物学 海洋生物学
- 计算流体动力学的流体动力学.
- 人工智能的人工智能
背景情况:
- 珊瑚礁生态系统是鱼类的重要息地,影响它们的行为,食和生存.
- 了解鱼类在复杂,动态的水流中的导航对于生态学和仿生学至关重要.
- 在珊瑚礁环境中模拟鱼类与移动目标和障碍物的相互作用带来了重大挑战.
研究的目的:
- 在复杂的珊瑚礁环境中调查鱼类的捕食和食行为.
- 开发一个整合模拟框架,将AI和流体动力学结合起来.
- 分析奖励机制对模拟鱼类决策的影响.
主要方法:
- 利用模拟框架,将深度强化学习 (DRL) 与沉浸边界格子博尔茨曼方法 (lB-LBM) 集成,用于流体结构相互作用.
- 采用软演员-批评 (SAC) 算法来增强探索和解决稀疏奖励挑战.
- 开发了一种定制的奖励塑造方法,以有效地捕捉结果和趋势特征.
主要成果:
- 通过两个案例研究证明了综合模拟框架的趋同性和稳定性.
- 成功模拟了鱼类在水静流中捕获随机移动的目标.
- 模拟鱼类在珊瑚礁环境中反流食,以捕获漂流的食物.
结论:
- 开发的模拟框架有效地模拟了动态水生环境中的复杂鱼类行为.
- 奖励塑造显著影响模拟鱼的决策过程.
- 这项研究为鱼类生态,行为提供了洞察力,并为仿生应用提供了潜力.
相关概念视频
Predator-Prey Interactions
16.2K
Predators consume prey for energy. Predators that acquire prey and prey that avoid predation both increase their chances of survival and reproduction (i.e., fitness). Routine predator-prey interactions elicit mutual adaptations that improve predator offenses, such as claws, teeth, and speed, as well as prey defenses, including crypsis, aposematism, and mimicry. Thus, predator-prey interactions resemble an evolutionary arms race.
16.2K
Instinctive Drift
203
Instinctive drift refers to the tendency of animals to revert to their innate behaviors despite repeated reinforcement. Breland and Breland demonstrated this concept in an experiment with a raccoon. The raccoon was trained to pick up two coins and place them in a container in exchange for food. Initially, the raccoon learned to associate the coins with food, making them a conditioned stimulus or a substitute for food. However, over time, the raccoon became less willing to put the coins into the...
203


