Jove
Visualize
Contact Us

Related Concept Videos

Unusual Results01:16

Unusual Results

Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ  from the mean, μ  is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
Regression Toward the Mean01:52

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...
Correlations02:20

Correlations

Correlation means that there is a relationship between two or more variables (such as ice cream consumption and crime), but this relationship does not necessarily imply cause and effect. When two variables are correlated, it simply means that as one variable changes, so does the other. We can measure correlation by calculating a statistic known as a correlation coefficient. A correlation coefficient is a number from -1 to +1 that indicates the strength and direction of the relationship between...
Correlation01:09

Correlation

In statistics, two variables are said to be correlated if the values of one variable are associated with the other variable. Depending on the relationship between two variables, correlation can be of three types– positive correlation, negative correlation, and zero correlation.
Two variables, for example, a and b, are said to be positively correlated if both variables move in the same direction. In other words, a positive correlation exists between two variables, a and b, if:
Distance Problem01:29

Distance Problem

When an object's velocity changes over time, the total distance traveled can be determined by summing small displacement intervals over short increments. This approach approximates the true distance through numerical summation and the use of integral calculus. An estimate of the total displacement can be obtained by measuring velocity at regular intervals and multiplying each value by the corresponding time step.If a runner accelerates over the first three seconds of a race, speed measurements...
Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can have a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Generalization of finger-joint kinematics for cleaning tasks.

Frontiers in robotics and AI·2026
Same author

ADMIRE: analysis of digitalized human-machine interactions and relations-looking closer at the tacit dimensions of human-machine relations as part of integrated research.

Frontiers in robotics and AI·2026
Same author

A review of ageing related biomarkers in breath.

Ageing research reviews·2026
Same author

The Epistemic Uncertainty Gradient in Spaces of Random Projections.

Entropy (Basel, Switzerland)·2025
Same author

Wasserstein task embedding for measuring task similarities.

Neural networks : the official journal of the International Neural Network Society·2024
Same author

A domain-agnostic approach for characterization of lifelong learning systems.

Neural networks : the official journal of the International Neural Network Society·2023
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: May 14, 2026

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

Solving the distal reward problem with rare correlations.

Andrea Soltoggio1, Jochen J Steil

  • 1Research Institute for Cognition and Robotics and Faculty of Technology, Bielefeld University, Bielefeld 33615, Germany. asoltogg@cor-lab.uni-bielefeld.de

Neural Computation
|January 24, 2013
PubMed
Summary
This summary is machine-generated.

This study shows that rare neural activity correlations, not precise spike timing, solve the distal reward problem in learning. This discovery is key for understanding how networks associate delayed rewards with past actions.

More Related Videos

A Conflict Model of Reward-seeking Behavior in Male Rats
06:11

A Conflict Model of Reward-seeking Behavior in Male Rats

Published on: February 20, 2019

Related Experiment Videos

Last Updated: May 14, 2026

Pavlovian Conditioned Approach Training in Rats
06:57

Pavlovian Conditioned Approach Training in Rats

Published on: February 4, 2016

A Conflict Model of Reward-seeking Behavior in Male Rats
06:11

A Conflict Model of Reward-seeking Behavior in Male Rats

Published on: February 20, 2019

Area of Science:

  • Computational neuroscience
  • Machine learning theory
  • Neural network modeling

Background:

  • Trial-and-error learning involves associating actions with delayed rewards or punishments.
  • The distal reward problem questions how rewards occurring seconds after an action can be linked to the neural activity that caused it, as that activity may no longer be present.

Purpose of the Study:

  • To investigate the role of neural activity correlation rarity versus precise spike timing in solving the distal reward problem.
  • To propose a novel computational model for learning with delayed rewards.

Main Methods:

  • Utilized a standard rate-based computational model.
  • Implemented a threshold-augmented Hebbian rule to detect rare correlations in neural activity.
  • Introduced a novel modulated plasticity rule.

Main Results:

  • Demonstrated that the rarity of neural activity correlations, rather than precise spike timing, enables networks to solve the distal reward problem.
  • Showed that the proposed modulated plasticity rule allows randomly connected networks to learn in classical and instrumental conditioning with delayed rewards.
  • Identified the rarity of correlations as crucial for learning and managing varying reward delays.

Conclusions:

  • The rarity of correlating neural activity is a pivotal factor in solving the distal reward problem.
  • Short-term synaptic plasticity may serve as an eligibility trace mechanism, selecting synapses for long-term potentiation.