Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Observational Learning

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...

PD Controller: Design

PD Controller: Design

In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...

Multi-input and Multi-variable systems

Multi-input and Multi-variable systems

Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...

Time-Domain Interpretation of PD Control

Time-Domain Interpretation of PD Control

Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Dairy byproducts as sustainable alternatives to FCS in 2D and 3D skeletal muscle cell cultures.

Bioresources and bioprocessing·2025

Same author

(Un)supervised (Co)adaptation via Incremental Learning for Myoelectric Control: Motivation, Review, and Future Directions.

IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society·2025

Same author

Comparative Analysis of Temporal Difference Learning Methods to Learn General Value Functions of Lower-Limb Signals.

IEEE ... International Conference on Rehabilitation Robotics : [proceedings]·2025

Same author

Neural Network Sparsity in Brain-Body-Machine Interfaces.

IEEE ... International Conference on Rehabilitation Robotics : [proceedings]·2025

Same author

Exploring the impact of myoelectric prosthesis controllers on visuomotor behavior.

Journal of neuroengineering and rehabilitation·2025

Same author

A performance evaluation of commercially available and 3D-printable prosthetic hands: a comparison using the anthropomorphic hand assessment protocol.

BMC biomedical engineering·2024

Search research articles

Related Experiment Video

Updated: Nov 19, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Examining the Use of Temporal-Difference Incremental Delta-Bar-Delta for Real-World Predictive Knowledge

Johannes Günther^1,2, Nadia M Ady¹, Alex Kearney¹

¹Department of Computing Science, University of Alberta, Edmonton, AB, Canada.

Frontiers in Robotics and AI

|January 27, 2021

Summary

This summary is machine-generated.

This study introduces Temporal-Difference Incremental Delta-Bar-Delta (TIDBD) for robot learning, enabling adaptive learning rates and improved prediction accuracy. TIDBD offers a robust alternative to traditional methods, even detecting sensor failures in robotic systems.

Keywords:

continual learning long-term autonomy prediction reinforcement learning robot learning

More Related Videos

Decoding Natural Behavior from Neuroethological Embedding

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

Related Experiment Videos

Last Updated: Nov 19, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Decoding Natural Behavior from Neuroethological Embedding

Decoding Natural Behavior from Neuroethological Embedding

Published on: October 3, 2025

Area of Science:

Robotics
Machine Learning
Control Systems

Background:

Predictive knowledge enhances robot control and other applications.
Online, incremental learning through environmental interaction is key for robotics.
A challenge is selecting appropriate learning parameters, such as learning rates or step sizes.

Purpose of the Study:

To examine online step-size adaptation using Temporal-Difference Incremental Delta-Bar-Delta (TIDBD).
To evaluate TIDBD as a practical alternative to classic Temporal-Difference (TD) learning.
To demonstrate TIDBD's ability to detect sensor failures in robotic applications.

Main Methods:

Applied TIDBD to a Modular Prosthetic Limb, a sensor-rich robotic arm.
TIDBD learns and adapts step sizes on a feature level, enabling simultaneous step-size tuning and representation learning.
Compared TIDBD's performance to classic TD learning with extensive parameter searches.

Main Results:

TIDBD performs comparably to hand-tuned TD learning in predicting robotic data streams.
TIDBD automatically detects patterns indicative of sensor failures, a common issue in robotic applications.
TIDBD demonstrates robustness to initial step-size values, outperforming classic TD.

Conclusions:

TIDBD is a practical and robust method for online step-size adaptation in robotic learning.
The approach improves the ability of robotic devices to learn from environmental interactions.
These findings enhance capabilities for autonomous agents and robots.