通过强化学习在流体流中引导波浪式微型游泳器
Zakarya El Khiyati1, Raphaël Chesneaux2, Laëtitia Giraldi1
1Université Côte d'Azur, Inria, CNRS, Sophia-Antipolis, Valbonne, France.
The European physical journal. E, Soft matter
|June 12, 2023
概括
研究人员开发了一种新的强化学习方法,用于微游泳者导航复杂的流体流. 这种方法克服了标准算法的局限性,为这些微小的,可变形的游泳者提供了高效的导航.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 流体动力学 流体动力学
- 人工智能的人工智能
背景情况:
- 微游泳器对于有针对性的药物输送和微观操纵至关重要.
- 导航复杂的,不均的流体流给微游泳者带来了重大挑战.
- 现有的控制方法与微游泳器推进和外部流场的合动力学作斗争.
研究的目的:
- 为在粘性液体中使用薄型,可变形的微型游泳器制定最佳的导航政策.
- 解决微游泳器控制的挑战,其中推进和外部流动相互作用交织在一起.
- 研究强化学习在自主微游泳导航中的应用.
主要方法:
- 利用强化学习算法来训练微游泳者.
- 采用多个独立实现的Q学习来构建政策.
- 在规定的非均流场中模拟的微游泳器与侧面波动.
主要成果:
- 标准的强化学习方法由于非马科夫的过程和混乱的动态而未能趋同.
- 一种基于Q学习的新方法成功生成了高效的导航政策.
- 开发的政策在复杂的流环境中表现出了稳健性和效率.
结论:
- 强化学习可以适应微游泳者在具有挑战性的流体环境中的导航.
- 提出的方法为设计有效的微游泳者控制策略提供了一个可行的替代方案.
- 了解游泳者动态和流动之间的相互作用对于最佳导航至关重要.
相关概念视频
Steady Flow of a Fluid Stream
316
Consider a control volume, such as a pipe with solid boundaries, through which fluid flows and changes direction due to the impulse exerted by the resulting force from the pipe walls. In steady flow, the mass of fluid entering the control volume at a given time, t, with velocity v1, is equal to the mass leaving after infinitesimal time dt, with velocity v2.
During this process, the momentum of the fluid within the control volume remains constant over the time interval dt. By applying the...
During this process, the momentum of the fluid within the control volume remains constant over the time interval dt. By applying the...
316
Turbulent Flow: Problem Solving
161
Carbonation is a process used to dissolve carbon dioxide gas in a liquid, commonly used in the production of carbonated beverages. Achieving efficient carbonation requires careful control of temperature, pressure, and flow conditions. By adjusting these parameters, carbonation efficiency can be maximized, producing a higher concentration of CO2 in the liquid.
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures...
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures...
161
Laminar Flow: Problem Solving
222
Laminar flow occurs when a fluid moves smoothly in parallel layers with minimal mixing and turbulence. In fluid mechanics, ensuring laminar flow within a pipe is essential for precise control of flow characteristics, especially in engineering applications. The key factor in determining whether flow remains laminar is the Reynolds number, a dimensionless quantity that depends on the fluid's velocity, density, viscosity, and the pipe's diameter. A Reynolds number of 2100 or lower...
222
Newtonian Fluid: Problem Solving
270
Newtonian fluids exhibit a constant viscosity, meaning their shear stress and shear strain rate are directly proportional. This property ensures a predictable and stable response to applied forces, maintaining a linear relationship between force and flow. Examples include water, air, and light oils, consistently demonstrating this proportional behavior regardless of external conditions.
A velocity gradient forms within the fluid when a Newtonian fluid is placed between two parallel plates, with...
A velocity gradient forms within the fluid when a Newtonian fluid is placed between two parallel plates, with...
270
Uniform Depth Channel Flow: Problem Solving
95
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
95
Steady, Laminar Flow in Circular Tubes
263
Hagen-Poiseuille flow describes a viscous fluid's steady, incompressible flow through a cylindrical tube with a constant radius R. This flow profile is often applied to understand fluid transport in narrow channels, such as capillaries. It serves as a foundational example of laminar flow. In this model, cylindrical coordinates (r,θ,z) are used to describe the radial (r), angular (θ), and axial (z) dimensions within the tube. For Hagen-Poiseuille flow, the velocity profile is...
263


