Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Linear time-invariant Systems01:23

Linear time-invariant Systems

901
A system is linear if it displays the characteristics of homogeneity and additivity, together termed the superposition property. This principle is fundamental in all linear systems. Linear time-invariant (LTI) systems include systems with linear elements and constant parameters.
The input-output behavior of an LTI system can be fully defined by its response to an impulsive excitation at its input. Once this impulse response is known, the system's reaction to any other input can be...
901
Continuous -time Fourier Transform01:11

Continuous -time Fourier Transform

899
The Fourier series is instrumental in representing periodic functions, offering a powerful method to decompose such functions into a sum of sinusoids. This technique, however, necessitates modification when applied to nonperiodic functions. Consider a pulse-train waveform consisting of a series of rectangular pulses. When these pulses have a finite period, they can be accurately represented by a Fourier series. Yet, as the period approaches infinity, resulting in a single, isolated pulse, the...
899
Basic Continuous Time Signals01:22

Basic Continuous Time Signals

685
Basic continuous-time signals include the unit step function, unit impulse function, and unit ramp function, collectively referred to as singularity functions. Singularity functions are characterized by discontinuities or discontinuous derivatives.
The unit step function, denoted u(t), is zero for negative time values and one for positive time values, exhibiting a discontinuity at t=0. This function often represents abrupt changes, such as the step voltage introduced when turning a car's...
685
Sampling Continuous Time Signal01:11

Sampling Continuous Time Signal

740
In signal processing, a continuous-time signal can be sampled using an impulse-train sampling technique, followed by the zero-order hold method. Impulse-train sampling involves the use of a periodic impulse train, which consists of a series of delta functions spaced at regular intervals determined by the sampling period. When a continuous-time signal is multiplied by this impulse train, it generates impulses with amplitudes corresponding to the signal's values at the sampling points.
In the...
740
BIBO stability of continuous and discrete -time systems01:24

BIBO stability of continuous and discrete -time systems

915
System stability is a fundamental concept in signal processing, often assessed using convolution. For a system to be considered bounded-input bounded-output (BIBO) stable, any bounded input signal must produce a bounded output signal. A bounded input signal is one where the modulus does not exceed a certain constant at any point in time.
To determine the BIBO stability, the convolution integral is utilized when a bounded continuous-time input is applied to a Linear Time-Invariant (LTI) system....
915
pH Scale02:41

pH Scale

79.5K
Hydronium and hydroxide ions are present both in pure water and in all aqueous solutions, and their concentrations are inversely proportional as determined by the ion product of water (Kw). The concentrations of these ions in a solution are often critical determinants of the solution’s properties and the chemical behaviors of its other solutes. Two different solutions can differ in their hydronium or hydroxide ion concentrations by a million, billion, or even trillion times. A common means of...
79.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Intrinsic Persistent Firing in CA1 Encodes Elapsed Time Across Behaviorally Relevant Scales.

Hippocampus·2026
Same author

Boundary Vector Cells Encode a Future-Biased Spectrum of Positions in the Rat.

Hippocampus·2026
Same author

Hippocampal astrocytic sequences emerge during learning and memory.

bioRxiv : the preprint server for biology·2026
Same author

Parsing inhibitory and mnemonic contributions to age-related decline in cognitive flexibility.

Psychology and aging·2026
Same author

Fast efficient coding and sensory adaptation in gain-adaptive recurrent networks.

Nature communications·2026
Same author

Human-level learning of complex novel tasks as theory-based modelling, exploration and planning.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences·2026
Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026
Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026
Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026
Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026
Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026
See all related articles

Related Experiment Video

Updated: Jan 29, 2026

Experimental Manipulation of Body Size to Estimate Morphological Scaling Relationships in Drosophila
06:00

Experimental Manipulation of Body Size to Estimate Morphological Scaling Relationships in Drosophila

Published on: October 1, 2011

14.3K

Estimating Scale-Invariant Future in Continuous Time.

Zoran Tiganj1, Samuel J Gershman2, Per B Sederberg3

  • 1Center for Memory and Brain, Department of Psychological and Brain Sciences, Boston, MA 02215, U.S.A. zoran.tiganj@gmail.com.

Neural Computation
|February 16, 2019
PubMed
Summary
This summary is machine-generated.

This study introduces a novel computational mechanism for estimating future outcomes in continuous time, offering a scale-invariant timeline for reinforcement learning. This approach overcomes limitations of current model-based and model-free algorithms.

More Related Videos

Using Generative Art to Convey Past and Future Climate Transitions
06:10

Using Generative Art to Convey Past and Future Climate Transitions

Published on: March 31, 2023

1.5K
Nutrient Regulation by Continuous Feeding for Large-scale Expansion of Mammalian Cells in Spheroids
11:01

Nutrient Regulation by Continuous Feeding for Large-scale Expansion of Mammalian Cells in Spheroids

Published on: September 25, 2016

8.1K

Related Experiment Videos

Last Updated: Jan 29, 2026

Experimental Manipulation of Body Size to Estimate Morphological Scaling Relationships in Drosophila
06:00

Experimental Manipulation of Body Size to Estimate Morphological Scaling Relationships in Drosophila

Published on: October 1, 2011

14.3K
Using Generative Art to Convey Past and Future Climate Transitions
06:10

Using Generative Art to Convey Past and Future Climate Transitions

Published on: March 31, 2023

1.5K
Nutrient Regulation by Continuous Feeding for Large-scale Expansion of Mammalian Cells in Spheroids
11:01

Nutrient Regulation by Continuous Feeding for Large-scale Expansion of Mammalian Cells in Spheroids

Published on: September 25, 2016

8.1K

Area of Science:

  • Computational neuroscience
  • Reinforcement learning
  • Cognitive psychology

Background:

  • Natural learners require estimating future outcomes in continuous time.
  • Current reinforcement learning algorithms discretize time, leading to drawbacks like increased computational cost or the need for timescale selection.
  • Model-based algorithms face linear growth in computational cost with simulation time.
  • Model-free algorithms necessitate choosing a specific timescale for discounting.

Purpose of the Study:

  • To present a scale-invariant computational mechanism for estimating future outcomes in continuous time.
  • To develop a method that overcomes the limitations of existing reinforcement learning algorithms.
  • To generate a power-law-discounted estimate of expected future reward efficiently.

Main Methods:

  • Developed a computational mechanism inspired by psychology and neuroscience.
  • Efficiently computes estimates of inputs as a function of future time on a logarithmically compressed scale.
  • Generates a scale-invariant power-law-discounted estimate of expected future reward.
  • Constructs the entire timeline in a single parallel operation.

Main Results:

  • The proposed mechanism computes a scale-invariant timeline of future outcomes.
  • It efficiently estimates future inputs on a logarithmically compressed time scale.
  • The representation of future time preserves information about event timing.
  • Generates concrete behavioral and neural predictions.

Conclusions:

  • The developed computational mechanism offers an efficient alternative for processing future outcomes in continuous time.
  • It provides a scale-invariant power-law-discounted reward estimate.
  • This mechanism has the potential to be integrated into future reinforcement learning algorithms for improved performance and efficiency.