Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

174
Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of...
174
Double Resonance Techniques: Overview01:12

Double Resonance Techniques: Overview

191
Double resonance techniques in Nuclear Magnetic Resonance (NMR) spectroscopy involve the simultaneous application of two different frequencies or radiofrequency pulses to manipulate and observe two distinct nuclear spins. One important application of double resonance is spin decoupling, which selectively suppresses coupling with one type of nucleus while observing the NMR signal from another nucleus, simplifying the spectrum and enhancing resolution.
Spin decoupling is usually achieved by...
191
Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

7.3K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.3K
Classification of Signals01:30

Classification of Signals

417
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
417
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

198
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
198
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

101
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
101

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Online supervised learning of temporal patterns in biological neural networks under feedback control.

Proceedings of the National Academy of Sciences of the United States of America·2026
Same author

Unsupervised Learning in Echo State Networks for Input Reconstruction.

Neural computation·2025
Same author

Modular architecture confers robustness to damage and facilitates recovery in spiking neural networks modeling <i>in vitro</i> neurons.

Frontiers in neuroscience·2025
Same author

Prediction of unobserved bifurcation by unsupervised extraction of slowly time-varying system parameter dynamics from time series using reservoir computing.

Frontiers in artificial intelligence·2024
Same author

Computation harvesting from nature dynamics for predicting wind speed and direction.

PloS one·2023
Same author

Biological neurons act as generalization filters in reservoir computing.

Proceedings of the National Academy of Sciences of the United States of America·2023

Related Experiment Video

Updated: Jun 11, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K

Dynamical predictive coding with reservoir computing performs noise-robust multi-sensory speech recognition.

Yoshihiro Yonemura1, Yuichi Katori1,2

  • 1Graduate of System Information Science, Future University Hakodate, Hakodate, Hokkaido, Japan.

Frontiers in Computational Neuroscience
|October 8, 2024
PubMed
Summary

This study demonstrates how reservoir computing models multi-sensory integration in the brain for speech recognition. The model effectively processes complex time series, weighting sensory inputs based on noise levels.

Keywords:
multi-sensory integrationnonlinear dynamicspredictive codingreservoir computingspeech recognition

More Related Videos

Microfluidic Platform with Multiplexed Electronic Detection for Spatial Tracking of Particles
11:54

Microfluidic Platform with Multiplexed Electronic Detection for Spatial Tracking of Particles

Published on: March 13, 2017

9.2K
Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

347

Related Experiment Videos

Last Updated: Jun 11, 2025

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.4K
Microfluidic Platform with Multiplexed Electronic Detection for Spatial Tracking of Particles
11:54

Microfluidic Platform with Multiplexed Electronic Detection for Spatial Tracking of Particles

Published on: March 13, 2017

9.2K
Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

347

Area of Science:

  • Computational Neuroscience
  • Cognitive Science
  • Machine Learning

Background:

  • Multi-sensory integration unifies information from different senses.
  • Understanding the neural basis of this process in the cortex is crucial.
  • Reservoir computing models recurrent neural networks for time series processing.

Purpose of the Study:

  • To extend a reservoir computing cortical model for multi-sensory integration.
  • To develop a dynamical model for multi-sensory speech recognition.
  • To investigate the role of predictive coding and reliability weighting.

Main Methods:

  • Developed a dynamical model combining reservoir computing and predictive coding.
  • Integrated reliability weighting for adaptive multi-sensory time series processing.
  • Applied the model to a multi-sensory speech recognition task.

Main Results:

  • The reservoir model successfully recognized speech by extracting time-contextual information.
  • Sensory inputs were effectively weighted according to sensory noise.
  • Demonstrated the model's ability to manage complex time series data.

Conclusions:

  • Recurrent network dynamics are suitable for multi-sensory time series processing.
  • Reservoir computing provides a viable computational model for cortical multi-sensory integration.
  • The proposed model advances understanding of neural mechanisms in perception.