相关实验视频

Updated: Jun 19, 2026

Shallow Water Paddling Variants of Water Maze Tests in Mice

Shallow Water Paddling Variants of Water Maze Tests in Mice

Published on: June 3, 2013

对微游泳者在复杂的水流中进行导航的强化学习方法进行批判性评估

Selim Mecanna¹, Aurore Loisy², Christophe Eloy³

¹Aix Marseille Univ, CNRS, Centrale Med, IRPHE, Marseille, France.

The European physical journal. E, Soft matter

|October 3, 2025

概括

在流体流中进行自主导航的强化学习表明,像近距离政策优化 (PPO) 这样的先进算法显著优于简单的方法,在复杂的环境中实现近乎最佳的策略.

科学领域:

流体力学流体力学流体力学
机器人技术机器人技术机器人技术
人工智能的人工智能

背景情况:

浮游生物和自主机器人面临的挑战是只使用车载传感器导航液体流.
强化学习 (RL) 越来越多地用于此,但算法性能往往不清楚.

研究的目的:

量化评估用于在部分可观测的流体流中导航的RL方法.
为了比较不同RL算法的性能与已知的准最佳策略.

主要方法:

引入了一个有着已知的分析解决方案的定向导航问题.
评估Q-学习和优势行为者批评 (A2C) 与近接政策优化 (PPO) 相比.
利用矢量化环境,概括优势估计和PPO的超参数优化.

主要成果:

常见的RL算法 (Q-Learning,A2C) 在各种流程中表现不佳,性能不佳.
PPO显著超过了这些方法,与流中的理论准最佳性能相匹配.
PPO展示了强大的,近乎最佳的导航策略.

结论:

算法选择和实施细节对于在复杂的流程中有效的自主导航至关重要.
像PPO这样的先进RL算法对于开发复杂的导航策略至关重要.
微调和先进的技术是实现基于RL的导航高性能的关键.

更多相关视频

Automated Analysis of C. elegans Swim Behavior Using CeleST Software

Automated Analysis of C. elegans Swim Behavior Using CeleST Software

Published on: December 7, 2016

Integrating Visual Psychophysical Assays within a Y-Maze to Isolate the Role that Visual Features Play in Navigational Decisions

Integrating Visual Psychophysical Assays within a Y-Maze to Isolate the Role that Visual Features Play in Navigational Decisions

Published on: May 2, 2019

相关概念视频

Uniform Depth Channel Flow: Problem Solving

Uniform Depth Channel Flow: Problem Solving

To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...