Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Randomized Experiments01:13

Randomized Experiments

8.6K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
8.6K
Expected Value01:15

Expected Value

6.8K
The expected value is known as the "long-term" average or mean. This means that over the long term of experimenting over and over, you would expect this average. The expected average is represented by the symbol μ. It is calculated as follows:
6.8K
Propagation of Uncertainty from Random Error00:59

Propagation of Uncertainty from Random Error

1.5K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
1.5K
Probability in Statistics01:14

Probability in Statistics

20.4K
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
20.4K
Propagation of Uncertainty from Systematic Error01:10

Propagation of Uncertainty from Systematic Error

1.1K
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
1.1K
Prediction Intervals01:03

Prediction Intervals

2.7K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y. 
2.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Representational similarity modulates neural and behavioral signatures of novelty.

Neuron·2026
Same author

Linking neural manifolds to circuit structure in recurrent networks.

Neuron·2026
Same author

Biologically informed cortical models predict optogenetic perturbations.

eLife·2026
Same author

Actor-critic networks with analogue memristors mimicking reward-based learning.

Nature machine intelligence·2025
Same author

Two-factor synaptic consolidation reconciles robustness with pruning and homeostatic scaling.

Proceedings of the National Academy of Sciences of the United States of America·2025
Same author

Novelty as a drive of human exploration in complex stochastic environments.

Proceedings of the National Academy of Sciences of the United States of America·2025

Related Experiment Video

Updated: Nov 22, 2025

Using the Threat Probability Task to Assess Anxiety and Fear During Uncertain and Certain Threat
11:18

Using the Threat Probability Task to Assess Anxiety and Fear During Uncertain and Certain Threat

Published on: September 12, 2014

15.5K

Learning in Volatile Environments With the Bayes Factor Surprise.

Vasiliki Liakoni1, Alireza Modirshanechi2, Wulfram Gerstner3

  • 1École Polytechnique Fédérale de Lausanne, School of Computer and Communication Sciences and School of Life Sciences, 1015 Lausanne, Switzerland vasiliki.liakoni@epfl.ch.

Neural Computation
|January 5, 2021
PubMed
Summary

Surprise-based learning enables agents to adapt quickly to changing environments. New algorithms using Bayes Factor Surprise improve adaptation and parameter estimation, outperforming existing methods.

More Related Videos

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.9K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

14.0K

Related Experiment Videos

Last Updated: Nov 22, 2025

Using the Threat Probability Task to Assess Anxiety and Fear During Uncertain and Certain Threat
11:18

Using the Threat Probability Task to Assess Anxiety and Fear During Uncertain and Certain Threat

Published on: September 12, 2014

15.5K
Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.9K
A Tactile Automated Passive-Finger Stimulator TAPS
19:44

A Tactile Automated Passive-Finger Stimulator TAPS

Published on: June 3, 2009

14.0K

Area of Science:

  • Computational neuroscience
  • Machine learning
  • Reinforcement learning

Background:

  • Agents need to adapt to nonstationary environments.
  • Surprise-based learning offers a mechanism for rapid adaptation.
  • Existing methods face challenges in balancing memory and new information.

Purpose of the Study:

  • To investigate surprise-modulated learning in hierarchical Bayesian models.
  • To introduce the Bayes Factor Surprise as a key modulator.
  • To develop novel, efficient surprise-based algorithms.

Main Methods:

  • Exact Bayesian inference in a hierarchical model.
  • Derivation of three novel algorithms: particle filter, variational learning, and message passing.
  • Analysis of Bayes Factor Surprise in existing approximate algorithms.

Main Results:

  • Bayes Factor Surprise modulates adaptation rates in existing algorithms.
  • Novel algorithms demonstrate constant scaling and simple updates for exponential family distributions.
  • Surprise-based algorithms achieve superior parameter estimation and performance.

Conclusions:

  • Surprise-based learning provides a unified framework for adaptation.
  • The proposed algorithms offer efficient and effective solutions for nonstationary environments.
  • Findings have implications for understanding behavior and improving reinforcement learning.