PPO-Based Reinforcement Learning Control of a Flapping-Wing Robot with a Bio-Inspired Sensing and Actuation Feather

Saddam Hussain1, Mohammed Messaoudi2, Muhammad Imran3

  • 1School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China.

PubMed
Summary

Bio-inspired feathers for flying robots act as sensors and actuators, improving stability in gusts. Reinforcement learning enables autonomous aerodynamic control for enhanced resilience and performance in flapping-wing drone designs.

Related Concept Videos

The Sense of Self: Reflected Self-Appraisal and Social Comparison02:57

The Sense of Self: Reflected Self-Appraisal and Social Comparison

According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
56.2K
Reinforcement01:23

Reinforcement

Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
960
Measurement: Derived Units03:02

Measurement: Derived Units

The International System of Units or SI system, by international agreement, has fixed measurement units for seven fundamental properties: length, mass, time, temperature, electric current, amount of substance, and luminosity. These are called the SI base units.
56.1K
Measurement: Standard Units03:38

Measurement: Standard Units

Every measurement provides three kinds of information: the size or magnitude of the measurement (a number), a standard of comparison for the measurement (a unit), and an indication of the uncertainty of the measurement. While the number and unit are explicitly represented when a quantity is written, the uncertainty is an aspect of the errors in the measurement results.
82.3K
Mechanism of Breathing I: Inspiration01:30

Mechanism of Breathing I: Inspiration

Introduction to Inspiration: The Respiratory System in Action
The respiratory system, an essential network for breathing, comprises the conducting and respiratory zones, each playing a crucial role in the overall process of respiration. Let us explore the detailed mechanism of inspiration, or inhalation, which is the first phase of the respiratory cycle.
Pathway of Air during Inspiration
During inspiration, air enters our body through the nose or mouth and moves through the conducting zone,...
3.3K
Corrosion of Reinforcement01:27

Corrosion of Reinforcement

The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
592