Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

PI Controller: Design01:24

PI Controller: Design

1.1K
Proportional Integral (PI) controllers are a fundamental component in modern control systems, widely used to enhance performance and mitigate steady-state errors. They are particularly effective in applications such as automatic brightness adjustment on smartphones, where they excel at mitigating steady-state errors for step-function inputs. Unlike PD controllers, which require time-varying errors to function optimally, PI controllers leverage their integral component to address residual...
1.1K
Rolling Resistance: Problem Solving01:17

Rolling Resistance: Problem Solving

732
Rolling resistance, also known as rolling friction, is the force that resists the motion of a rolling object, such as a wheel, tire, or ball, when it moves over a surface. It is caused by the deformation of the object and the surface in contact with each other, as well as other factors like internal friction, hysteresis, and energy losses within the materials. Rolling resistance opposes the object's motion, requiring additional energy to overcome it and maintain movement. In practical...
732
Relative Motion Analysis using Rotating Axes-Problem Solving01:29

Relative Motion Analysis using Rotating Axes-Problem Solving

657
Consider a crane whose telescopic boom rotates with an angular velocity of 0.04 rad/s and angular acceleration of 0.02 rad/s2. Along with the rotation, the boom also extends linearly with a uniform speed of 5 m/s. The extension of the boom is measured at point D, which is measured with respect to the fixed point C on the other end of the boom. For the given instant, the distance between points C and D is 60 meters.
Here, in order to determine the magnitude of velocity and acceleration for point...
657
Indirect Motor Pathways01:22

Indirect Motor Pathways

2.9K
The indirect motor or extrapyramidal pathways originate in the brainstem, the lower portion of the brain that connects it to the spinal cord. They consist of several distinct tracts, each with specialized functions. The four main tracts of the indirect motor pathways are the vestibulospinal tract, the reticulospinal tract, the tectospinal tract, and the rubrospinal tract.
The vestibulospinal tract originates in the vestibular nuclei of the brainstem. The vestibular system detects changes in...
2.9K
Velocity and Position by Integral Method01:13

Velocity and Position by Integral Method

7.3K
If acceleration as a function of time is known, then velocity and position functions can be derived using integral calculus. For constant acceleration, the integral equations refer to the first and second kinematic equations for velocity and position functions, respectively.
Consider an example to calculate the velocity and position from the acceleration function. A motorboat is traveling at a constant velocity of 5.0 m/s when it starts to decelerate to arrive at the dock. Its acceleration is...
7.3K
Kinematic Equations: Problem Solving01:15

Kinematic Equations: Problem Solving

27.2K
When analyzing one-dimensional motion with constant acceleration, the problem-solving strategy involves identifying the known quantities and choosing the appropriate kinematic equations to solve for the unknowns. Either one or two kinematic equations are needed to solve for the unknowns, depending on the known and unknown quantities. Generally, the number of equations required is the same as the number of unknown quantities in the given example. Two-body pursuit problems always require two...
27.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Retrotransposon long interspersed nucleotide element-1 (LINE-1) is activated during salamander limb regeneration.

Development, growth & differentiation·2012
Same author

Highly shape-selective synthesis of monodispersed fivefold twinned platinum nanodecahedrons and nanoicosahedrons.

Chemistry (Weinheim an der Bergstrasse, Germany)·2012
Same author

Isolation and characterization of primary skeletal muscle satellite cells from rats.

Toxicology mechanisms and methods·2012
Same author

Workplace violence and influencing factors among medical professionals in China.

American journal of industrial medicine·2012
Same author

Systematic analysis of microRNA fingerprints in thrombocythemic platelets using integrated platforms.

Blood·2012
Same author

Lead acetate reduces the ability of human umbilical cord mesenchymal stem cells to support hematopoiesis in vitro.

Molecular medicine reports·2012

Related Experiment Video

Updated: Jan 1, 2026

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
11:53

The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

Published on: October 14, 2017

12.1K

A Path-Integral-Based Reinforcement Learning Algorithm for Path Following of an Autoassembly Mobile Robot.

Wei Zhu, Xian Guo, Yongchun Fang

    IEEE Transactions on Neural Networks and Learning Systems
    |December 28, 2019
    PubMed
    Summary

    This study introduces a novel path-integral reinforcement learning (RL) algorithm for mobile robot path following. The method enhances real-world robot training by improving simulation-to-reality transfer and reducing data costs.

    More Related Videos

    Operation of the Collaborative Composite Manufacturing CCM System
    10:09

    Operation of the Collaborative Composite Manufacturing CCM System

    Published on: October 1, 2019

    7.0K
    An Innovative Running Wheel-based Mechanism for Improved Rat Training Performance
    07:51

    An Innovative Running Wheel-based Mechanism for Improved Rat Training Performance

    Published on: September 19, 2016

    9.2K

    Related Experiment Videos

    Last Updated: Jan 1, 2026

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy
    11:53

    The Modular Design and Production of an Intelligent Robot Based on a Closed-Loop Control Strategy

    Published on: October 14, 2017

    12.1K
    Operation of the Collaborative Composite Manufacturing CCM System
    10:09

    Operation of the Collaborative Composite Manufacturing CCM System

    Published on: October 1, 2019

    7.0K
    An Innovative Running Wheel-based Mechanism for Improved Rat Training Performance
    07:51

    An Innovative Running Wheel-based Mechanism for Improved Rat Training Performance

    Published on: September 19, 2016

    9.2K

    Area of Science:

    • Robotics
    • Artificial Intelligence
    • Control Systems

    Background:

    • Deep reinforcement learning (RL) excels in virtual environments but struggles with real-world robot control due to simulation inaccuracies and high data acquisition costs.
    • Practical robot applications, especially for dynamic systems, are limited by the complexity of accurate simulation and the expense of real-world training data.

    Purpose of the Study:

    • To develop an effective reinforcement learning (RL) algorithm for mobile robot path following that addresses challenges in real-world training.
    • To improve the reliability and efficiency of training practical robot systems by bridging the gap between simulation and physical implementation.

    Main Methods:

    • A generalized path-integral control approach is proposed to solve stochastic dynamical systems, avoiding gradient and inverse kinematics calculations for faster convergence.
    • A novel parameterization method using Lyapunov techniques is integrated into the RL algorithm to ensure robust performance when transferring simulation results to real systems.
    • Optimal parameters are learned offline for discrete initial states and then tuned online to enhance generalization and real-time capabilities.

    Main Results:

    • The proposed path-integral-based RL algorithm demonstrates superior performance in path following for autoassembly mobile robots.
    • Simulation and experimental results validate the algorithm's effectiveness and its ability to generalize to other nonlinear systems, such as crane systems.
    • The method successfully overcomes common obstacles in real-world robot training, including simulation complexity and data cost.

    Conclusions:

    • The developed RL algorithm offers a significant advancement for practical robot control, particularly in path following tasks.
    • The approach enhances the transferability of learned policies from simulation to physical robots, reducing development time and cost.
    • The algorithm's general applicability to nonlinear systems suggests broad potential for future robotic and control system applications.