Related Experiment Video
Updated: May 30, 2025

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
Deep reinforcement learning and robust SLAM based robotic control algorithm for self-driving path optimization.
Samiullah Khan1, Ashfaq Niaz1, Dou Yinke1
1College of Electrical and Power Engineering, Taiyuan University of Technology, Taiyuan, China.
This study introduces a novel reward shaping deep deterministic policy gradient (RS-DDPG) algorithm for robotic path tracking. The improved RS-DDPG enhances accuracy and robustness in dynamic environments compared to standard DDPG.
Area of Science:
- Robotics
- Artificial Intelligence
- Computer Vision
Background:
- Robotic control during maneuvers often suffers from low accuracy and poor robustness in target path tracking.
- Existing Simultaneous Localization and Mapping (SLAM) algorithms struggle with robustness and dynamic object interference in visual sensing.
Purpose of the Study:
- To propose a novel reward shaping deep deterministic policy gradient (RS-DDPG) algorithm for enhanced robotic path tracking.
- To develop a robust visual SLAM algorithm for dynamic scenes using semantic segmentation and geometric information.
Main Methods:
- Implemented a reward shaping mechanism within the Deep Deterministic Policy Gradient (DDPG) framework to optimize tracking parameters.
- Developed a visual SLAM algorithm integrating semantic segmentation and geometric information for improved dynamic scene handling.
- Utilized the Apollo autonomous driving simulation platform for comparative performance analysis.
Main Results:
- The RS-DDPG algorithm demonstrated superior path tracking accuracy and robustness compared to the standard DDPG algorithm.
- The enhanced visual SLAM system showed significantly improved performance in dynamic scenarios.
- Simulation experiments validated the effectiveness of the proposed integrated approach.
Conclusions:
- The proposed RS-DDPG algorithm offers a significant improvement for robotic path tracking accuracy and stability.
- The integration of semantic segmentation and geometric information enhances the robustness of visual SLAM in dynamic environments.
- This research contributes to more reliable autonomous systems in complex, real-world conditions.
Related Concept Videos
Rolling Resistance: Problem Solving
Hierarchy of Motor Control
Three-Dimensional Force System:Problem Solving
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
One-Degree-of-Freedom System
A one-degree-of-freedom system is defined by an independent variable that determines its state and behavior. One example of a one-degree-of-freedom system is a simple harmonic oscillator, such as a...
Relative Motion Analysis using Rotating Axes-Problem Solving
Here, in order to determine the magnitude of velocity and acceleration for point...

