Related Experiment Video
Updated: Feb 14, 2026

Manufacturing, Control, and Performance Evaluation of a Gecko-Inspired Soft Robot
Published on: June 10, 2020
PPO-Based Reinforcement Learning Control of a Flapping-Wing Robot with a Bio-Inspired Sensing and Actuation Feather
Saddam Hussain1, Mohammed Messaoudi2, Muhammad Imran3
1School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China.
Bio-inspired feathers for flying robots act as sensors and actuators, improving stability in gusts. Reinforcement learning enables autonomous aerodynamic control for enhanced resilience and performance in flapping-wing drone designs.
Area of Science:
- Robotics
- Bio-inspired Engineering
- Aerodynamics
Background:
- Flapping-wing flying robots (FWFRs) require enhanced stability in dynamic environments.
- Bio-inspired mechanisms offer potential for improved flow-sensing and actuation.
- Current FWFRs lack adaptive aerodynamic control for gusty conditions.
Purpose of the Study:
- To introduce a bio-inspired sensing and actuation feather unit (SAFU) for FWFRs.
- To develop a physics-based model for training a reinforcement learning controller.
- To enable autonomous aerodynamic adaptation and improve FWFR stability.
Main Methods:
- Developed a bio-inspired SAFU mimicking falcon covert feathers.
- Created a reduced-order bond-graph model of coupled aero-electromechanical dynamics.
- Utilized proximal policy optimization (PPO) reinforcement learning for control.
Main Results:
- The PPO-driven SAFU achieved fast, well-damped responses (rise time < 0.5s, settling time < 1.4s).
- Demonstrated up to 50% alleviation of airflow-induced disturbance effects in gusty conditions.
- Showcased autonomous regulation of feather displacement and load reduction.
Conclusions:
- Bio-inspired SAFUs combined with reinforcement learning enhance FWFR resilience.
- This approach enables intelligent aerodynamic control and autonomous flow adaptation.
- Highlights potential for advanced flapping-wing drone designs.
Related Concept Videos
The Sense of Self: Reflected Self-Appraisal and Social Comparison
Reinforcement
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Measurement: Derived Units
Measurement: Standard Units
Mechanism of Breathing I: Inspiration
The respiratory system, an essential network for breathing, comprises the conducting and respiratory zones, each playing a crucial role in the overall process of respiration. Let us explore the detailed mechanism of inspiration, or inhalation, which is the first phase of the respiratory cycle.
Pathway of Air during Inspiration
During inspiration, air enters our body through the nose or mouth and moves through the conducting zone,...
Corrosion of Reinforcement
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...

