Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Stochastic resonance in noisy threshold neurons.

Bart Kosko1, Sanya Mitaim

  • 1Department of Electrical Engineering, Signal and Image Processing Institute, University of Southern California, Los Angeles, CA 90089-2564, USA.

Neural Networks : the Official Journal of the International Neural Network Society
|July 10, 2003
PubMed
Summary

Small amounts of noise can enhance signal detection in threshold neurons, a phenomenon known as stochastic resonance. This effect improves information processing, even with extreme noise fluctuations.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Noise can speed backpropagation learning and deep bidirectional pretraining.

Neural networks : the official journal of the International Neural Network Society·2020
Same author

Noise can speed Markov chain Monte Carlo estimation and quantum annealing.

Physical review. E·2019
Same author

Noise-boosted bidirectional backpropagation and adversarial learning.

Neural networks : the official journal of the International Neural Network Society·2019
Same author

Noise-enhanced convolutional neural networks.

Neural networks : the official journal of the International Neural Network Society·2015
Same author

Noise-benefit forbidden-interval theorems for threshold signal detectors based on cross correlations.

Physical review. E, Statistical, nonlinear, and soft matter physics·2014
Same author

Noise enhanced array signal detection in P300 speller paradigm using ICA-based subspace projections.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2013

Area of Science:

  • Computational Neuroscience
  • Information Theory
  • Nonlinear Dynamics

Background:

  • Stochastic resonance (SR) is a phenomenon where noise enhances the performance of nonlinear systems.
  • Threshold neurons are fundamental units in neural processing, often dealing with noisy inputs.
  • Understanding how noise impacts neural signal detection is crucial for neuroscience.

Purpose of the Study:

  • To present general stochastic-resonance theorems for threshold neurons processing noisy input sequences.
  • To quantify the impact of additive noise on neuronal information processing using Shannon mutual information.
  • To establish conditions under which noise enhances, rather than degrades, neuronal performance.

Main Methods:

  • Development of two general theorems for stochastic resonance in threshold neurons.

Related Experiment Videos

  • Analysis of noisy Bernoulli input sequences and Shannon mutual information as a performance measure.
  • Investigation of finite-variance (e.g., gamma) and infinite-variance (stable distributions) noise types.

    • Main Results:

    • Demonstrated that small amounts of independent additive noise can increase the mutual information of threshold neurons detecting subthreshold signals.
    • Proved the stochastic-resonance effect holds for a broad class of finite-variance noise distributions (including gamma noise) with a controllable mean.
    • Showed the stochastic-resonance effect is robust for infinite-variance noise within the stable distributions family, applicable to impulsive noise environments.

    Conclusions:

    • Additive noise can beneficially impact information processing in threshold neurons, a key finding for neural computation.
    • The stochastic-resonance effect is broadly applicable across various noise types, including those modeling extreme conditions.
    • These findings provide theoretical support for the role of noise in enhancing neural signal detection and processing.