基于PPO的强化学习控制一个带有生物灵感感应和执行羽毛单元的飞翼机器人
Saddam Hussain1, Mohammed Messaoudi2, Muhammad Imran3
1School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China.
Sensors (Basel, Switzerland)
|February 13, 2026
概括
飞行机器人的生物灵感羽毛充当传感器和执行器,改善风暴中的稳定性. 强化学习可以实现自主空气动力学控制,以提高飞翼无人机设计中的弹性和性能.
科学领域:
- 机器人技术 机器人技术 机器人技术
- 生物启发工程 生物启发工程
- 空气动力学 航空动力学
背景情况:
- 飞行机器人 (FWFR) 需要在动态环境中提高稳定性.
- 生物灵感机制为改善流量传感和执行提供了潜力.
- 目前的FWFR缺乏适应性空气动力学控制,以适应强风条件.
研究的目的:
- 为FWFRs引入一个生物灵感的传感和执行羽毛单元 (SAFU).
- 开发一个基于物理的模型来训练强化学习控制器.
- 为了实现自主空气动力学适应并提高FWFR的稳定性.
主要方法:
- 开发了一种生物灵感的SAFU,模仿猎的隐形羽毛.
- 创建了合的空气电机动力学的减少顺序键图模型.
- 利用近接政策优化 (PPO) 强化学习进行控制.
主要成果:
- 采用PPO驱动的SAFU实现了快速,缓和的响应 (上升时间<0.5s,沉降时间<1.4s).
- 在强风条件下,证明了高达50%的减轻空气流引起的干扰效应.
- 展示了羽毛位移和负载减轻的自主调节.
结论:
- 生物启发的SAFU与强化学习相结合,增强FWFR的弹性.
- 这种方法可以实现智能空气动力学控制和自主流量适应.
- 突出了先进的飞翼无人机设计的潜力.
相关概念视频
The Sense of Self: Reflected Self-Appraisal and Social Comparison
56.2K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
56.2K
Reinforcement
960
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
960
Measurement: Derived Units
56.1K
The International System of Units or SI system, by international agreement, has fixed measurement units for seven fundamental properties: length, mass, time, temperature, electric current, amount of substance, and luminosity. These are called the SI base units.
56.1K
Measurement: Standard Units
82.3K
Every measurement provides three kinds of information: the size or magnitude of the measurement (a number), a standard of comparison for the measurement (a unit), and an indication of the uncertainty of the measurement. While the number and unit are explicitly represented when a quantity is written, the uncertainty is an aspect of the errors in the measurement results.
82.3K
Mechanism of Breathing I: Inspiration
3.3K
Introduction to Inspiration: The Respiratory System in Action
The respiratory system, an essential network for breathing, comprises the conducting and respiratory zones, each playing a crucial role in the overall process of respiration. Let us explore the detailed mechanism of inspiration, or inhalation, which is the first phase of the respiratory cycle.
Pathway of Air during Inspiration
During inspiration, air enters our body through the nose or mouth and moves through the conducting zone,...
The respiratory system, an essential network for breathing, comprises the conducting and respiratory zones, each playing a crucial role in the overall process of respiration. Let us explore the detailed mechanism of inspiration, or inhalation, which is the first phase of the respiratory cycle.
Pathway of Air during Inspiration
During inspiration, air enters our body through the nose or mouth and moves through the conducting zone,...
3.3K
Corrosion of Reinforcement
592
The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
592


