Reinforcement learning in linear embedding space unlocks generalizable control across soft robot configurations

Xinglong Zhang1, Cong Li2, Hangjie Mo3

  • 1College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China. zhangxinglong18@nudt.edu.cn.

Abstract

Related Concept Videos

Open and closed-loop control systems01:17

Open and closed-loop control systems

Control systems are foundational elements in automation and engineering. They are broadly categorized into open-loop and closed-loop systems. These classifications hinge on the presence or absence of feedback mechanisms, significantly influencing the system's performance, complexity, and application.
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal and...
Linear Approximation in Time Domain01:21

Linear Approximation in Time Domain

Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length, the...
Hierarchy of Motor Control01:18

Hierarchy of Motor Control

The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Vectors in Space: Problem Solving01:26

Vectors in Space: Problem Solving

A chandelier suspended by multiple cables can be analyzed using principles of three-dimensional static equilibrium. In this setup, a chandelier weighing 1000 N is positioned at the origin of a three-dimensional coordinate system, while three ceiling anchor points are fixed at known locations above it. Each cable connects the chandelier to one anchor point and transmits a tensile force along its length.To find out the forces in the cables, the spatial direction of each cable must first be...
One-Degree-of-Freedom System01:24

One-Degree-of-Freedom System

In mechanical engineering, one-degree-of-freedom systems form the basis of a wide range of electrical and mechanical components. Using these models, engineers can predict the behavior of various parts in a larger system, which gives them insight into how different forces interact with each other.
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...