Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 11, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Reward-based learning for virtual neurorobotics through emotional speech processing.

Laurence C Jayet Bray1, Gareth B Ferneyhough, Emily R Barker

  • 1Department of Computer Science and Engineering, University of Nevada Reno, NV, USA ; Department of Bioengineering, George Mason University Fairfax, VA, USA.

Frontiers in Neurorobotics
|May 4, 2013
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sparse transformer with local and seasonal adaptation for multivariate time series forecasting.

Scientific reports·2024
Same author

A novel extreme adaptive GRU for multivariate time series forecasting.

Scientific reports·2024
Same author

A robust and accurate single-cell data trajectory inference method using ensemble pseudotime.

BMC bioinformatics·2023
Same author

Review: pathophysiology of intracranial hypertension and noninvasive intracranial pressure monitoring.

Fluids and barriers of the CNS·2020
Same author

Toward automated classification of pathological transcranial Doppler waveform morphology via spectral clustering.

PloS one·2020
Same author

Algorithm for Reliable Detection of Pulse Onsets in Cerebral Blood Flow Velocity Signals.

Frontiers in neurology·2019
Same journal

DSPE-ViT: a lightweight vision transformer with dynamic sparse positional encoding for dense small object detection in UAV imagery.

Frontiers in neurorobotics·2026
Same journal

ST-HONet: Spatio-Temporal Hierarchical Network for long-horizon bimanual visuomotor imitation.

Frontiers in neurorobotics·2026
Same journal

ST-HADP: Spatio-Temporal hierarchical attention diffusion policy for long-horizon generalizable bimanual visuomotor imitation.

Frontiers in neurorobotics·2026
Same journal

EQISP: efficient quantized image signal processing with multi-scale pyramid fusion for resource constrained embodied perception.

Frontiers in neurorobotics·2026
Same journal

Research on embodied agent multimodal perception and real-time path planning algorithms for complex unstructured environments.

Frontiers in neurorobotics·2026
Same journal

NL-YOLOv5: a model with a larger receptive field and the ability to globally acquire features.

Frontiers in neurorobotics·2026
See all related articles

This study integrates emotional speech processing (ESP) with virtual neurorobotics for enhanced human-robot interaction. The system successfully enabled a virtual robot to learn tasks using spoken rewards and simulated neural plasticity.

Area of Science:

  • Computational Neuroscience
  • Robotics
  • Artificial Intelligence

Background:

  • Reward-based learning is effective in human and machine contexts.
  • Advancements in emotional speech processing (ESP) enable more natural human-robot interaction.
  • Integrating ESP into virtual neurorobotic (VNR) applications is a novel approach.

Purpose of the Study:

  • To develop and integrate a novel emotional speech processing system into a virtual neurorobotic application.
  • To enable a virtual neurorobot to learn through reward-based learning using spoken emotional feedback.
  • To investigate the combination of human emotions and virtual neurorobotics.

Main Methods:

  • Developed an emotional speech classifier distinguishing happy and sad utterances with high accuracy (95.3% offline, 98.7% live).
Keywords:
biological computational modelemotional speech processingreward-based learningvirtual neurorobotics

More Related Videos

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

Related Experiment Videos

Last Updated: May 11, 2026

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis
05:48

Memorization-Based Training and Testing Paradigm for Robust Vocal Identity Recognition in Expressive Speech Using Event-Related Potentials Analysis

Published on: August 9, 2024

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
07:14

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

  • Integrated the ESP system into a virtual neurorobotic scenario.
  • Implemented reward-based learning where spoken rewards stimulated synaptic plasticity (STDP) in a simulated neural model.

    • Main Results:

    • The emotional speech classifier achieved high accuracy in both offline and live modes.
    • The virtual neurorobot successfully and consistently learned a simple exercise through the integrated ESP and reward-based learning system.
    • Spoken rewards reinforced corresponding neural pathways via STDP.

    Conclusions:

    • The integration of ESP in real-time computational neuroscience architecture is feasible.
    • This work represents a significant first step towards combining human emotions with virtual neurorobotics.
    • The developed system demonstrates the potential for more intuitive and effective human-robot collaboration.