Related Experiment Video
Updated: May 9, 2026

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
Published on: March 2, 2015
Novel deep reinforcement learning based collision avoidance approach for path planning of robots in unknown
Raed Alharthi1, Iram Noreen2, Amna Khan1
1Department of Computer Science and Engineering, University of Hafr Al-Batin, Hafar Al-Batin, Saudi Arabia.
This study introduces a novel Q-learning reinforcement learning algorithm integrated with deep learning for robot motion planning. The approach enhances environmental responsiveness and path convergence in complex, cluttered spaces.
Area of Science:
- Artificial Intelligence
- Robotics
- Machine Learning
Background:
- Traditional motion planning algorithms struggle with real-time environmental responses, especially in cluttered spaces.
- Existing methods are computationally expensive, slow to converge, and inefficient for task learning.
- Reinforcement learning offers a promising solution through its reward-based feedback mechanisms.
Purpose of the Study:
- To develop a novel reinforcement learning algorithm for improved robot motion planning.
- To enhance the responsiveness and convergence speed of robotic navigation in complex environments.
- To integrate deep learning with Q-learning for superior path planning capabilities.
Main Methods:
- A novel Q-learning-based reinforcement learning algorithm was developed.
- Deep learning was integrated into the reinforcement learning framework.
- The algorithm was evaluated in simulated narrow and cluttered passage environments.
Main Results:
- The proposed algorithm demonstrated improved convergence rates compared to existing methods.
- In cluttered environments, the agent converged in 210 episodes.
- In narrow passages, the agent converged in 400 episodes, outperforming state-of-the-art approaches in path convergence and number of turns.
Conclusions:
- The novel Q-learning and deep learning approach significantly enhances robot motion planning efficiency.
- The algorithm provides faster convergence and better path planning in challenging, obstacle-rich environments.
- This research paves the way for more adaptive and responsive robotic navigation systems.
Related Concept Videos
Elastic Collisions: Introduction
Elastic Collisions: Case Study
Collisions in Multiple Dimensions: Introduction
Collisions in Multiple Dimensions: Problem Solving
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
Rolling Resistance: Problem Solving
Avoidance Learning and Learned Helplessness
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...

