多代理增强学习用于控制三维雷利-贝纳德对流的控制
Joel Vasanth1, Jean Rabault2, Francisco Alcántara-Ávila1
1FLOW, Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden.
概括
多剂强化学习 (MARL) 有效地控制了流体动力学,将雷利-贝纳德对流的对流强度降低了高达23.5%. 这种先进的深度强化学习方法优于传统方法,并证明了政策的可转移性.
科学领域:
- 流体动力学 流体动力学
- 计算物理 计算物理
- 人工智能的人工智能
背景情况:
- 深度强化学习 (DRL) 越来越多地应用于流量控制挑战.
- 多代理增强学习 (MARL) 是DRL的一个子集,在控制具有局部和不变性质的流量方面表现出色.
- 三维雷利-贝纳德对流 (RBC) 呈现出复杂的流动动态,可以采用先进的控制策略.
研究的目的:
- 实施和评估基于MARL的三维雷利-贝纳德对流的控制系统.
- 评估MARL在降低对流强度和稳定流量模式方面的有效性.
- 将MARL的性能与传统的比例控制方法进行比较.
主要方法:
- 在RBC模拟中,MARL药物被开发用于控制红细胞细分底壁上的温度分布.
- 对两个RBC疗法进行了模拟,其雷利号为500和750.
- 评估了学习的MARL政策,以减少对流强度,模式转换和可转移到更大的领域.
主要成果:
- 在MARL对照中,Ra=500时的对流强度减少了23.5%,Ra=750.时的对流强度减少了8.7%.
- 不规则的对流模式被转化为稳定,直线的滚卷,表明更稳定的流量状态.
- 马尔显著超过了比例控制,并证明了成功地将政策转移到更大的模拟领域.
结论:
- 马尔提供了一种强大而有效的方法来控制复杂的流体现象,如RBC.
- 学习的MARL策略表现出强度和适应性,优于传统的控制技术.
- 马尔的不变属性使得学习政策的直接转移成为可能,从而提高了实际应用.
相关概念视频
Turbulent Flow: Problem Solving
382
Carbonation is a process used to dissolve carbon dioxide gas in a liquid, commonly used in the production of carbonated beverages. Achieving efficient carbonation requires careful control of temperature, pressure, and flow conditions. By adjusting these parameters, carbonation efficiency can be maximized, producing a higher concentration of CO2 in the liquid.
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures enhance...
Temperature is a key factor in CO2 solubility. In this case, the CO2 gas and the liquid are cooled to 20°C. Lower temperatures enhance...
382
Three-Dimensional Force System:Problem Solving
1.3K
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
1.3K
Laminar Flow: Problem Solving
502
Laminar flow occurs when a fluid moves smoothly in parallel layers with minimal mixing and turbulence. In fluid mechanics, ensuring laminar flow within a pipe is essential for precise control of flow characteristics, especially in engineering applications. The key factor in determining whether flow remains laminar is the Reynolds number, a dimensionless quantity that depends on the fluid's velocity, density, viscosity, and the pipe's diameter. A Reynolds number of 2100 or lower...
502
Newtonian Fluid: Problem Solving
865
Newtonian fluids exhibit a constant viscosity, meaning their shear stress and shear strain rate are directly proportional. This property ensures a predictable and stable response to applied forces, maintaining a linear relationship between force and flow. Examples include water, air, and light oils, consistently demonstrating this proportional behavior regardless of external conditions.
A velocity gradient forms within the fluid when a Newtonian fluid is placed between two parallel plates, with...
A velocity gradient forms within the fluid when a Newtonian fluid is placed between two parallel plates, with...
865
Conduction, Convection and Radiation: Problem Solving
2.2K
There are three methods by which heat transfer can take place: conduction, convection, and radiation. Each method has unique and interesting characteristics, but all three have two things in common: they transfer heat solely because of a temperature difference; and the greater the temperature difference, the faster the heat transfer.
In order to solve a problem related to heat transfer, first of all, the situation needs to be examined to determine the type of heat transfer involved. This could...
In order to solve a problem related to heat transfer, first of all, the situation needs to be examined to determine the type of heat transfer involved. This could...
2.2K
Uniform Depth Channel Flow: Problem Solving
429
To calculate the flow rate for a trapezoidal channel, first, identify the bottom width, side slope, and flow depth of the channel. The cross-sectional area (A) corresponding to the depth of flow (y), channel bottom width (B), and side slope (θ) is determined by:Next, calculate the wetted perimeter, which includes the bottom width and the sloped side lengths in contact with the water. Using the values of the cross-sectional area and the wetted perimeter, determine the hydraulic radius by...
429


