Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 14, 2026

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

Properties of a temporal difference reinforcement learning brain machine interface driven by a simulated motor

Aditya Tarigoppula1, Nick Rotella, Joseph T Francis

  • 1Department of Physiology and Pharmacology, SUNY Downstate Medical Center, Brooklyn, 450 Clarkson Avenue, Brooklyn, NY 11203, USA. aditya30887@gmail.com

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
|February 1, 2013
PubMed
Summary

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

High Classification Accuracy of Touch Locations from S1 LFPs Using CNNs and Fastai.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2022
Same author

A Mixed Filtering Approach for Real-Time Seizure State Tracking Using Multi-Channel Electroencephalography Data.

IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society·2021
Same author

An EEG-fNIRS hybridization technique in the four-class classification of alzheimer's disease.

Journal of neuroscience methods·2020
Same author

Reward Expectation Modulates Local Field Potentials, Spiking Activity and Spike-Field Coherence in the Primary Motor Cortex.

eNeuro·2019
Same author

Paradigm Shift in Sensorimotor Control Research and Brain Machine Interface Control: The Influence of Context on Sensorimotor Representations.

Frontiers in neuroscience·2018
Same author

Reward value is encoded in primary somatosensory cortex and can be decoded from neural activity during performance of a psychophysical task.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2017

This study explores reinforcement learning (RL) for brain-computer interfaces. Researchers analyzed the stability and convergence of a Temporal Difference (TD) RL model using a simulated motor cortex.

Area of Science:

  • Neuroscience
  • Machine Learning
  • Biomedical Engineering

Background:

  • Brain-computer interfaces (BCIs) aim to restore function through neural decoding.
  • Reinforcement learning (RL) offers a promising approach for adaptive neural decoding.

Purpose of the Study:

  • To investigate the stability and convergence of a Temporal Difference (TD) RL architecture for BCIs.
  • To establish a foundation for developing RL-based decoders for neural data.

Main Methods:

  • Simulated a motor cortex to generate neural data.
  • Implemented a Temporal Difference (TD) reinforcement learning algorithm.
  • Analyzed the stability and convergence properties of the RL architecture under simulated neural input.

Main Results:

More Related Videos

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment
10:14

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

Published on: May 10, 2024

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Related Experiment Videos

Last Updated: May 14, 2026

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment
10:14

Motor Imagery Performance Through Embodied Digital Twins in a Virtual Reality-Enabled Brain-Computer Interface Environment

Published on: May 10, 2024

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

  • The TD RL architecture demonstrated basic stability.
  • The RL model exhibited convergence properties under simulated motor cortex activity.
  • Initial findings support the feasibility of RL for neural decoding.

Conclusions:

  • Reinforcement learning is a viable strategy for developing advanced BCI decoders.
  • Further research is warranted to optimize RL algorithms for real-world BCI applications.
  • This work provides crucial insights into the performance of RL in neural decoding contexts.