Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Cellulose-Based Superabsorbent Hydrogel with Recyclable Moisture Regulation for Agriculture in Arid Regions.

Journal of agricultural and food chemistry·2026

Same author

Trends for Proton Transport Activity and Stability in Turnbull's Blue Analogues: Theory and Experiments.

Chemistry of materials : a publication of the American Chemical Society·2026

Same author

Corrigendum to "Spatial confinement-enhanced CHA system based on tetrahedral DNA nanostructures for sensitive in situ mRNA analysis" [Talanta 306 (2026) 129764].

Talanta·2026

Same author

From byproduct to bioresource: Antioxidant potential, flavor profile, and microbiological quality of recovered water from freeze-dried and rotary evaporation dried Muscat grapes.

Food chemistry·2026

Same author

Class prototype rectification and multi-scale feature measurement for few-shot classification of bearing surface defects.

Scientific reports·2026

Same author

Synergistic regulation by the stay-green gene family maintains green flower coloration via chlorophyll degradation in chrysanthemum.

Plant physiology and biochemistry : PPB·2026

Same journal

Confidence-driven adaptive time window for real-time driver fatigue detection in Level 2-3 autonomous vehicles: a multi-dataset validation study.

Frontiers in neurorobotics·2026

Same journal

DSPE-ViT: a lightweight vision transformer with dynamic sparse positional encoding for dense small object detection in UAV imagery.

Frontiers in neurorobotics·2026

Same journal

ST-HONet: Spatio-Temporal Hierarchical Network for long-horizon bimanual visuomotor imitation.

Frontiers in neurorobotics·2026

Same journal

ST-HADP: Spatio-Temporal hierarchical attention diffusion policy for long-horizon generalizable bimanual visuomotor imitation.

Frontiers in neurorobotics·2026

Same journal

EQISP: efficient quantized image signal processing with multi-scale pyramid fusion for resource constrained embodied perception.

Frontiers in neurorobotics·2026

Same journal

Research on embodied agent multimodal perception and real-time path planning algorithms for complex unstructured environments.

Frontiers in neurorobotics·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Jul 18, 2025

Using a Split-belt Treadmill to Evaluate Generalization of Human Locomotor Adaptation

Using a Split-belt Treadmill to Evaluate Generalization of Human Locomotor Adaptation

Published on: August 23, 2017

A parallel heterogeneous policy deep reinforcement learning algorithm for bipedal walking motion design.

Chunguang Li¹, Mengru Li², Chongben Tao²

¹School of Computer and Information Engineering, Changzhou Institute of Technology, Changzhou, Jiangsu, China.

Frontiers in Neurorobotics

|August 24, 2023

Summary

This summary is machine-generated.

This study introduces a novel Deep Reinforcement Learning algorithm for optimizing biped robot gaits. The proposed method enhances walking speed and stability in biped robots across various environments.

Keywords:

Deep Deterministic Policy Gradient biped robot experience replay gait optimization parallel heterogeneous strategy

More Related Videos

Asymmetric Walkway: A Novel Behavioral Assay for Studying Asymmetric Locomotion

Asymmetric Walkway: A Novel Behavioral Assay for Studying Asymmetric Locomotion

Published on: January 15, 2016

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Published on: July 22, 2014

Related Experiment Videos

Last Updated: Jul 18, 2025

Using a Split-belt Treadmill to Evaluate Generalization of Human Locomotor Adaptation

Using a Split-belt Treadmill to Evaluate Generalization of Human Locomotor Adaptation

Published on: August 23, 2017

Asymmetric Walkway: A Novel Behavioral Assay for Studying Asymmetric Locomotion

Asymmetric Walkway: A Novel Behavioral Assay for Studying Asymmetric Locomotion

Published on: January 15, 2016

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Engineering Platform and Experimental Protocol for Design and Evaluation of a Neurally-controlled Powered Transfemoral Prosthesis

Published on: July 22, 2014

Area of Science:

Robotics
Artificial Intelligence
Control Systems

Background:

Biped robot locomotion presents significant challenges due to complex dynamics and non-linear characteristics.
Existing gait optimization methods struggle with adaptability across diverse environments and robot models.

Purpose of the Study:

To develop an efficient and robust gait optimization algorithm for biped robots.
To improve walking speed, stability, and adaptability of biped robots in varied conditions.

Main Methods:

A parallel heterogeneous policy Deep Reinforcement Learning (DRL) algorithm utilizing the Deep Deterministic Policy Gradient (DDPG) architecture.
Implementation of shared networks for enhanced training efficiency and heterogeneous experience replay for optimized experience utilization.
Design of a periodic gait based on sinusoidal curves, incorporating foot lift height, walking period, speed, and ground contact force.

Main Results:

The proposed DRL algorithm successfully optimized biped robot gaits, leading to faster locomotion.
Experimental results demonstrate significantly improved walking stability across different environments and robot models.
The unified gait optimization framework proved effective in diverse simulation scenarios on the RoboCup3D platform.

Conclusions:

The developed parallel heterogeneous DRL approach offers a powerful solution for biped robot gait optimization.
The method enhances key performance metrics, making biped robots more practical for real-world applications.
The unified framework provides a versatile platform for future research in bipedal locomotion.