Related Experiment Video
Updated: Mar 29, 2026

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
Published on: October 14, 2017
Reinforcement Learning-Based Control of a 4-Wheel Independent Steering Mobile Robot for Robust Path Tracking in
1Department of Robot and Smart System Engineering, Kyungpook National University, Daegu 41566, Republic of Korea.
Abstract:
This paper proposes a reinforcement learning (RL)-based control method for robust path tracking of a 4-wheel independent steering (4WIS) mobile robot in outdoor rough terrain environments. Traditional wheeled robots typically suffer from limitations including mobility constraints in narrow spaces, path deviations caused by ground slip, and reduced traction on rough terrain. To address these challenges, we designed a 4WIS mobile robot and implemented an architecture that independently controls the steering and driving of each wheel. The RL state space is defined by look-ahead path information, robot pose, velocity, and tracking errors, while the action space consists of target angular velocity and steering angle. To ensure robust performance, we applied random path and terrain generation and implemented domain randomization for sensors and actuators based on empirical GPS and motor data. The proposed controller was validated against the Pure Pursuit algorithm through dynamic simulations and real-world experiments. In simulations mimicking outdoor terrain, the controller reduced lateral and heading RMSE by 6.32% and 16.00%, respectively. In actual outdoor environments, it reduced these errors by 21.54% and 4.78%, respectively. These results demonstrate that the proposed controller provides superior robust tracking performance in unstructured outdoor environments.
Related Concept Videos
Rolling Resistance: Problem Solving
PD Controller: Design
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Open and closed-loop control systems
An open-loop control system operates without feedback from the output. It consists of two primary elements: the controller and the controlled process. The controller receives an input signal...
Relative Motion Analysis using Rotating Axes-Problem Solving
Here, in order to determine the magnitude of velocity and acceleration for point...
Rolling Resistance
For instance, imagine a hard cylinder rolling on a comparatively soft surface. The cylinder's weight compresses the surface beneath it. As the cylinder moves, the material in front of it slows down due to...

