Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 14, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Brain-Machine Interface control of a robot arm using actor-critic rainforcement learning.

Eric A Pohlmeyer1, Babak Mahmoudi, Shijia Geng

  • 1Department of Biomedical Engineering, Miami University, Coral Gables, Fl 33146, USA.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
|February 1, 2013
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

PCSK9 promotes atherosclerosis progression through the FOXO3a autophagy signaling pathway.

Frontiers in cardiovascular medicine·2026
Same author

Artificial Intelligence-Enhanced Electrocardiogram for Longitudinal Evaluation of Right Ventricular Dysfunction After Acute Pulmonary Embolism: Rational and Design of CURES-CARE Study.

Pulmonary circulation·2026
Same author

Reconstructing 12-lead ECG from 3-lead ECG using variational autoencoder to improve cardiac disease detection of wearable ECG devices.

PLOS digital health·2026
Same author

ECGomics: An Open Platform for AI-ECG Digital Biomarker Discovery.

Health data science·2026
Same author

SpiroLLM: Finetuning pretrained LLMs to understand spirogram time series with clinical validation in COPD reporting.

PLOS digital health·2026
Same author

MEETI: A Multimodal ECG Dataset from MIMIC-IV-ECG with Signals, Images, Features and Interpretations.

Scientific data·2026
Same journal

Analysis of End-Tidal CO2 Variability During Plateau Waves Episodes: An Information Theoretic Approach<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

AI and Tomosynthesis for Breast Cancer Molecular Subtyping: A step toward precision medicine<sup></sup>.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Towards Sustainable Protein Recovery from Biological Waste: Assessing Polyethersulfone-based Microfiltration.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Analysis of the cardiovascular response to standardized polymicrobial peritonitis experimental model.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

Automated Wrist Ultrasound Image Bone Enhancement and Segmentation Using Deep Learning.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
Same journal

A Deep Learning approach for Depressive Symptoms assessment in Parkinson's disease patients using facial videos.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
See all related articles

Marmoset monkeys learned to control robot arms using a reinforcement learning (RL) Brain-Machine Interface (BMI). This adaptive BMI system achieved high performance with minimal training, offering robust control for future applications.

Area of Science:

  • Neuroscience
  • Robotics
  • Machine Learning

Background:

  • Brain-Machine Interfaces (BMIs) traditionally rely on supervised learning for decoding neural activity.
  • Supervised learning requires extensive, pre-defined training datasets, limiting adaptability.
  • Existing BMI control models can be sensitive to changes in neural input or task requirements.

Purpose of the Study:

  • To demonstrate a marmoset monkey's ability to control a robot arm using a reinforcement learning (RL) Brain-Machine Interface (BMI).
  • To investigate the efficacy of an actor-critic RL algorithm for decoding neural activity in the motor cortex for robotic control.
  • To highlight the advantages of adaptive RL-based decoding over static, supervised learning methods in BMIs.

Main Methods:

  • An actor-critic reinforcement learning (RL) algorithm was employed to decode neural ensemble activity from the marmoset's motor cortex.

More Related Videos

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients
06:11

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients

Published on: April 18, 2025

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

Related Experiment Videos

Last Updated: May 14, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients
06:11

Brain-Computer Interface-controlled Upper Limb Robotic System for Enhancing Daily Activities in Stroke Patients

Published on: April 18, 2025

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
10:51

An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

Published on: March 10, 2011

  • The RL algorithm controlled the movements of a robot arm during a two-target decision task.
  • The system utilized a basic feedback signal for incremental adaptation of model parameters, bypassing the need for explicit training data.

    • Main Results:

    • The RL-based BMI achieved high performance, accurately mapping neural states to robot actions with 94% accuracy.
    • The system demonstrated rapid learning, enabling accurate real-time robot arm control after only a few trials.
    • The adaptive nature of the RL algorithm allowed for robust control despite potential perturbations.

    Conclusions:

    • Reinforcement learning provides an effective and adaptive approach for Brain-Machine Interface control.
    • RL-based BMIs offer advantages in terms of reduced training data requirements and enhanced robustness.
    • This study showcases a novel BMI decoding method with significant potential for advanced neuroprosthetic applications.