Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Relative Motion Analysis using Rotating Axes-Problem Solving01:29

Relative Motion Analysis using Rotating Axes-Problem Solving

407
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
407
Planar Rigid-Body Motion01:22

Planar Rigid-Body Motion

452
Understanding the movement of a rigid body in planar motion involves recognizing that every particle within this body is traversing a path that maintains a consistent distance from a specific plane. This concept is fundamental in the study of physics and mechanical engineering, and it allows us to comprehend better how objects move in space.
Planar motion is typically divided into three distinct categories. The first is rectilinear translation, demonstrated by a subway train that moves along...
452
Root-Locus Method01:19

Root-Locus Method

160
A cruise control system in a car is designed to maintain a specified speed automatically by adjusting the gas pedal. The system continuously measures the vehicle's speed and makes fine adjustments to the pedal to achieve this goal. The root locus method is particularly useful for understanding how the cruise control system's behavior changes under varying conditions, such as when the car goes uphill, downhill, or faces strong wind resistance.
This system can be represented by a block...
160
Rolling Resistance: Problem Solving01:17

Rolling Resistance: Problem Solving

352
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
352
Three-Dimensional Force System:Problem Solving01:30

Three-Dimensional Force System:Problem Solving

674
A three-dimensional force system refers to a scenario in which three forces act simultaneously in three different directions. This type of problem is commonly encountered in physics and engineering, where it is necessary to calculate the resultant force on the system, which can then be used to predict or analyze the behavior of the object or structure under consideration.
To solve a three-dimensional force system, first resolve each force into its respective scalar components. Do this using...
674

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Star-like Cobalt Sulfide Nanoarrays Coupled with Fe Single-Atom Catalyst as Binder-Free Integrated Cathodes for Efficient and Robust Seawater Zinc-Air Batteries.

Molecules (Basel, Switzerland)·2026
Same author

ANGPT1-GABARAP axis modulates NLRP3 inflammasome-mediated pyroptosis in Crohn's disease.

Frontiers in immunology·2026
Same author

Climate Change and Hydropower Impacts on Habitat Suitability of Endangered Schizothoracinae Fishes in the Qinghai-Xizang Plateau.

Ecology and evolution·2026
Same author

A physiologically relevant in vitro screening model for predictive assessment of foundation colour shift.

International journal of cosmetic science·2026
Same author

Transient Plasmonic Photothermal Imaging Deciphers Dynamic Thermal Transfer during the Cell Cycle.

Chemical & biomedical imaging·2026
Same author

GLIM‑Defined Malnutrition in Critically Ill Patients: A Comparison of Nutrition Risk Screening 2002 and Modified Nutrition Risk in Critically Ill as First‑Step Screening Tools.

Journal of multidisciplinary healthcare·2026

Related Experiment Video

Updated: Jul 12, 2025

Manufacturing, Control, and Performance Evaluation of a Gecko-Inspired Soft Robot
07:40

Manufacturing, Control, and Performance Evaluation of a Gecko-Inspired Soft Robot

Published on: June 10, 2020

14.0K

A Path-Planning Method Based on Improved Soft Actor-Critic Algorithm for Mobile Robots.

Tinglong Zhao1, Ming Wang1, Qianchuan Zhao2

  • 1School of Information and Electrical Engineering, Shandong Jianzhu University, Jinan 250101, China.

Biomimetics (Basel, Switzerland)
|October 27, 2023
PubMed
Summary
This summary is machine-generated.

This study introduces an enhanced deep reinforcement learning algorithm for mobile robot path planning, improving navigation in unknown environments. The refined algorithm, using maximum entropy and hindsight experience replay, overcomes limitations of traditional methods for more efficient learning.

Keywords:
hindsight experience replaymobile robotpath planningreinforcement learningsoft actor-critic

More Related Videos

Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.6K
The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

11.7K

Related Experiment Videos

Last Updated: Jul 12, 2025

Manufacturing, Control, and Performance Evaluation of a Gecko-Inspired Soft Robot
07:40

Manufacturing, Control, and Performance Evaluation of a Gecko-Inspired Soft Robot

Published on: June 10, 2020

14.0K
Operation of the Collaborative Composite Manufacturing CCM System
10:09

Operation of the Collaborative Composite Manufacturing CCM System

Published on: October 1, 2019

6.6K
The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

11.7K

Area of Science:

  • Robotics
  • Artificial Intelligence
  • Machine Learning

Background:

  • Mobile robot path planning is increasingly important with robot popularization.
  • Reinforcement learning (RL) enables robots to navigate and plan paths in unknown, obstacle-filled environments through interaction.
  • Conventional RL methods face challenges like inadequate incentives and inefficient sample utilization during training.

Purpose of the Study:

  • To present a refined deep reinforcement learning algorithm for mobile robot path planning.
  • To improve upon the soft actor-critic (SAC) algorithm by incorporating maximum entropy for enhanced path planning efficacy.
  • To address limitations of conventional RL, including poor incentives and sample inefficiency, especially in complex scenarios.

Main Methods:

  • Developed a refined deep reinforcement learning algorithm based on the soft actor-critic (SAC) framework.
  • Integrated the concept of maximum entropy into the SAC algorithm for improved path planning.
  • Incorporated the hindsight experience replay (HER) mechanism to enhance algorithm performance by reusing past experiences and addressing training inefficiencies.

Main Results:

  • The enhanced algorithm demonstrates superior performance compared to existing methods in simulation studies.
  • The integration of maximum entropy and HER effectively mitigates constraints of conventional RL.
  • The refined algorithm shows improved efficacy in the learning process and better accommodation of intricate path planning situations.

Conclusions:

  • The proposed enhanced deep reinforcement learning algorithm offers a more effective solution for mobile robot path planning.
  • The combination of maximum entropy and hindsight experience replay significantly boosts learning efficiency and performance.
  • This approach provides a robust method for robots to navigate complex and unfamiliar environments.