Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Aug 29, 2025

Brain State-dependent Brain Stimulation with Real-time Electroencephalography-Triggered Transcranial Magnetic Stimulation
08:50

Brain State-dependent Brain Stimulation with Real-time Electroencephalography-Triggered Transcranial Magnetic Stimulation

Published on: August 20, 2019

14.5K

Kernel Temporal Differences for EEG-based Reinforcement Learning Brain Machine Interfaces.

Bhoj Raj Thapa, Daniel Restrepo Tangarife, Jihye Bae

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference
    |September 10, 2022
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Music for epilepsy: impact of temporal music structure on intervention outcomes.

    Epilepsy & behavior : E&B·2026
    Same author

    Transfer Learning in EEG-based Reinforcement Learning Brain Machine Interfaces via Q-learning Kernel Temporal Differences.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same author

    A Window Analysis for the Decoding of Premovement and Movement Intentions in Freewill EEG<sup></sup>.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same author

    A large electroencephalogram database of freewill reaching and grasping tasks for brain machine interfaces.

    Scientific data·2025
    Same author

    Digital health interventions for colorectal cancer screening uptake: A scoping review.

    PLOS digital health·2025
    Same author

    Long-Term Neurodevelopmental Outcomes After Antenatal Corticosteroid Therapy in Late Preterm Twins: A Nationwide Retrospective Cohort Study.

    Journal of Korean medical science·2025
    Same journal

    Analysis of End-Tidal CO2 Variability During Plateau Waves Episodes: An Information Theoretic Approach<sup></sup>.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same journal

    AI and Tomosynthesis for Breast Cancer Molecular Subtyping: A step toward precision medicine<sup></sup>.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same journal

    Towards Sustainable Protein Recovery from Biological Waste: Assessing Polyethersulfone-based Microfiltration.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same journal

    Analysis of the cardiovascular response to standardized polymicrobial peritonitis experimental model.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same journal

    Automated Wrist Ultrasound Image Bone Enhancement and Segmentation Using Deep Learning.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    Same journal

    A Deep Learning approach for Depressive Symptoms assessment in Parkinson's disease patients using facial videos.

    Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2025
    See all related articles

    The Q-KTD algorithm shows promise for EEG-based brain-machine interfaces, achieving 100% success in open-loop experiments. This noninvasive approach offers continuous learning and adaptation for controlling external devices.

    Area of Science:

    • Neuroscience
    • Machine Learning
    • Biomedical Engineering

    Background:

    • Reinforcement learning brain-machine interfaces (RLBMIs) enable continuous adaptation.
    • Previous RLBMIs primarily used invasive intracortical recordings.
    • The Q-KTD algorithm demonstrated success in prior intracortical BMI studies.

    Purpose of the Study:

    • Investigate the feasibility of the Q-KTD algorithm for electroencephalography (EEG)-based RLBMIs.
    • Evaluate Q-KTD performance using noninvasive EEG data.
    • Explore the potential of EEG-based RLBMIs for controlling external devices.

    Main Methods:

    • Utilized two public EEG datasets (Data set A and Data set B) for motor imagery tasks.
    • Integrated EEG motor imagery into a center-out reaching task.

    More Related Videos

    Performing Behavioral Tasks in Subjects with Intracranial Electrodes
    12:10

    Performing Behavioral Tasks in Subjects with Intracranial Electrodes

    Published on: October 2, 2014

    11.5K
    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
    10:51

    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

    Published on: March 10, 2011

    13.8K

    Related Experiment Videos

    Last Updated: Aug 29, 2025

    Brain State-dependent Brain Stimulation with Real-time Electroencephalography-Triggered Transcranial Magnetic Stimulation
    08:50

    Brain State-dependent Brain Stimulation with Real-time Electroencephalography-Triggered Transcranial Magnetic Stimulation

    Published on: August 20, 2019

    14.5K
    Performing Behavioral Tasks in Subjects with Intracranial Electrodes
    12:10

    Performing Behavioral Tasks in Subjects with Intracranial Electrodes

    Published on: October 2, 2014

    11.5K
    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces
    10:51

    An Experimental Platform to Study the Closed-loop Performance of Brain-machine Interfaces

    Published on: March 10, 2011

    13.8K
  • Analyzed open-loop RLBMI experiments using Q-KTD with raw and Fourier transform features.

    • Main Results:

    • Achieved 100% average success rates in open-loop RLBMI experiments after learning.
    • Data set A converged within ~20 epochs for raw features.
    • Data set B converged within ~40 epochs for both raw and Fourier transform features.

    Conclusions:

    • Q-KTD is applicable to EEG-based RLBMIs, demonstrating feasibility for noninvasive brain-computer interfaces.
    • Further research is needed to improve learning speed and optimize kernel units for closed-loop applications.
    • Results support continued investigation of Q-KTD in EEG-based closed-loop RLBMIs.