使用强化学习优化执行器故障耐受性控制,用于四旋翼无人驾驶飞行器的态势动态系统
Guoxing Wen1, Guanlong Li2, Lingyu Zhang3
1College of Science, Shandong University of Aeronautics, Binzhou, 256600, Shandong, China.
ISA transactions
|January 22, 2026
概括
本研究介绍了四旋翼无人驾驶飞行器 (QUAV) 具有执行器故障的故障耐受性优化后退控制. 这种新方法提高了稳定性,并通过强化学习优化了控制性能.
科学领域:
- 机器人和控制系统 机器人和控制系统
- 航空航天工程 航空航天工程
- 人工智能的人工智能
背景情况:
- 四旋翼无人机 (QUAV) 需要强大的姿态控制系统.
- 优化后退 (OB) 控制提供了性能优势,但可能是复杂的.
- 执行器故障对QUAV的态度稳定性和运行可靠性构成重大挑战.
研究的目的:
- 为 QUAV 态度系统开发一个对故障耐受性优化后退 (OB) 控制策略.
- 通过与强化学习 (RL) 的整合,提高OB控制对执行器故障的弹性.
- 在OB控制框架内减少RL算法的计算复杂性.
主要方法:
- 整合强化学习 (RL) 与未知的执行器效率因子和偏差信号的自适应估计.
- 对于批评者和演员网络的RL训练规律的演,使用梯度下降方法在一个简化的正函数上,相当于汉密尔顿-雅各比-贝尔曼 (HJB) 方程.
- 应用利亚普诺夫稳定理论,严格证明拟议的耐故障控制方案的稳定性.
主要成果:
- 提出的耐故障的OB控制器有效地管理QUAV态度系统中的执行器故障.
- 强化学习集成显著提高了后退控制的稳定性和容错性.
- 简化的RL方法可以明显减少算法复杂性,同时保持最佳的控制性能.
- 模拟示例和莱普诺夫稳定性证明验证了开发的控制策略的有效性和可靠性.
结论:
- 开发的耐故障优化后退控制方案为QUAV在执行器故障时的姿态稳定提供了强大的解决方案.
- 将自适应式RL与OB控制集成为提高自主空中系统可靠性的有希望的方法.
- 该研究成功展示了一种减轻控制系统复杂性的方法,同时确保高性能和故障耐受性.
更多相关视频
06:45Design and Application of a Fault Detection Method Based on Adaptive Filters and Rotational Speed Estimation for an Electro-Hydrostatic Actuator
Published on: October 28, 2022
2.1K
08:17Free-form Light Actuators — Fabrication and Control of Actuation in Microscopic Scale
Published on: May 25, 2016
9.6K
相关概念视频
Attitudes
32.7K
Attitude is our evaluation of a person, an idea, or an object. We have attitudes for many things ranging from products that we might pick up in the supermarket to people around the world to political policies. Typically, attitudes are favorable or unfavorable: positive or negative (Eagly & Chaiken, 1993). And, they have three components: an affective component (feelings), a behavioral component (the effect of the attitude on behavior), and a cognitive component (belief and knowledge;...
32.7K
Fault Types
408
When analyzing a single line-to-ground fault from phase A to ground at a three-phase bus, it is important to consider the fault impedance. This impedance is zero for a bolted fault, equal to the arc impedance for an arcing fault, and represents the total fault impedance for a transmission-line insulator flashover. To derive sequence and phase currents, fault conditions are translated from the phase domain to the sequence domain.
For line-to-line faults occurring between phases B and C, the...
For line-to-line faults occurring between phases B and C, the...
408
Reinforcement
872
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
872
Corrosion of Reinforcement
531
The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
531
Reinforcement Schedules
479
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
479
Reinforcements in Concrete
453
Reinforced concrete is a composite material used extensively in construction, combining the compressive strength of concrete with the tensile strength of steel. This synergy is essential as concrete, while excellent at resisting compression, is weak under tension. Steel bars, or rebars, are embedded in the concrete to handle these tensile forces. The choice of steel is strategic; it shares a similar coefficient of thermal expansion with concrete, which ensures uniformity in response to...
453
