Related Experiment Video
Updated: Jul 5, 2025

07:52
Investigating Motor Skill Learning Processes with a Robotic Manipulandum
Published on: February 12, 2017
8.7K
Autonomous Driving of Mobile Robots in Dynamic Environments Based on Deep Deterministic Policy Gradient: Reward
Minjae Park1, Chaneun Park2, Nam Kyu Kwon1
1Department of Electronic Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea.
Biomimetics (Basel, Switzerland)
|January 22, 2024
Summary
This study introduces a reinforcement learning method for mobile robot navigation in dynamic, obstacle-filled environments. The approach uses reward shaping and hindsight experience replay to achieve collision-free autonomous driving.
Area of Science:
- Robotics
- Artificial Intelligence
- Machine Learning
Background:
- Autonomous navigation in dynamic environments presents significant challenges for mobile robots.
- Traditional methods often struggle with real-time obstacle avoidance and optimal path planning.
Purpose of the Study:
- To develop an end-to-end reinforcement learning method for autonomous mobile robot driving.
- To enhance navigation efficiency and safety in dynamic, obstacle-rich environments.
Main Methods:
- Proposed a reinforcement learning (RL)-based end-to-end learning approach.
- Integrated multifunctional reward-shaping for goal-directed guidance.
- Utilized hindsight experience replay to overcome sparse reward challenges.
Main Results:
- The proposed method demonstrated effective autonomous driving capabilities.
- Successful navigation without collisions was achieved in both simulated and real-world tests.
- Comparative experiments across five scenarios validated the technique's performance.
Conclusions:
- The combined reinforcement learning techniques enable optimal policy discovery for collision-free navigation.
- The method is robust and effective in dynamic environments with obstacles.
- This approach advances autonomous driving systems for mobile robots.
Related Concept Videos
Rolling Resistance: Problem Solving
335
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
335
Hierarchy of Motor Control
2.8K
The hierarchy of motor control refers to the different levels of organization and processing involved in controlling movement in the body. These levels range from higher cortical areas involved in planning and decision-making to lower spinal cord reflexes that respond automatically to external stimuli.
2.8K
Role of Shaping in Operant Conditioning
324
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
324
PD Controller: Design
234
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
234

