Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Propagation of Uncertainty from Random Error

Propagation of Uncertainty from Random Error

An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...

Propagation of Uncertainty from Systematic Error

Propagation of Uncertainty from Systematic Error

The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...

Linear Approximation in Time Domain

Linear Approximation in Time Domain

Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...

Linear Approximation in Frequency Domain

Linear Approximation in Frequency Domain

Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Data-based iterative learning control for nonlinear systems subject to iteration-dependent durations.

ISA transactions·2025

Same author

Data-Based Robust Tracking Control for Learning Systems Under Disturbance Observers.

IEEE transactions on cybernetics·2025

Same author

Optimizing the safety-efficiency trade-off on nationwide air traffic network flow using cooperative co-evolutionary paradigm.

Scientific reports·2025

Same author

Development and application of high-performance drilling hole protection materials.

Scientific reports·2025

Same author

Controllable distribution of surface-modified MIL-53 with ruthenium nanoparticles on nickel foam and its high efficiency electrocatalytic hydrogen evolution.

Dalton transactions (Cambridge, England : 2003)·2025

Same author

Efficacy and prognostic factors of PD-1 inhibitors combined with apatinib in advanced diffuse gastric cancer.

Neoplasma·2025

Same journal

Intervention Feasible Region and Driver Risk Capacity Aware Human-Machine Collaborative Safe Trajectory Planning.

IEEE transactions on neural networks and learning systems·2026

Same journal

A Unified Differential Denoising Learning Framework With a Pre-Trained Model and Fuzzy Graph Networks for Drug-Drug Interaction Prediction.

IEEE transactions on neural networks and learning systems·2026

Same journal

Self-Supervised Continuous Dynamic Graph Representation Learning via Hawkes Processes.

IEEE transactions on neural networks and learning systems·2026

Same journal

cPU: Consistent Risk Estimator for Positive-Unlabeled Learning.

IEEE transactions on neural networks and learning systems·2026

Same journal

Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing.

IEEE transactions on neural networks and learning systems·2026

Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026

See all related articles

Search research articles

Related Experiment Video

Updated: May 24, 2025

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

Probabilistic Approximation of Stochastic Time Series Using Bayesian Recurrent Neural Network.

Yuhang Wang, Kaiquan Cai, Deyuan Meng

IEEE Transactions on Neural Networks and Learning Systems

|March 3, 2025

Summary

This summary is machine-generated.

This study analyzes Bayesian recurrent neural networks for time series forecasting. We show that transforming series into latent variable models and using Bayes by Backprop with more samples improves forecasting accuracy and convergence.

More Related Videos

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

Published on: May 25, 2019

Related Experiment Videos

Last Updated: May 24, 2025

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

A Method of Trigonometric Modelling of Seasonal Variation Demonstrated with Multiple Sclerosis Relapse Data

Published on: December 9, 2015

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

A Method for Tracking the Time Evolution of Steady-State Evoked Potentials

Published on: May 25, 2019

Area of Science:

Machine Learning
Time Series Analysis
Probabilistic Modeling

Background:

Stochastic time series possess cumulative dependencies challenging for standard recurrent neural networks.
Bayesian recurrent neural networks (BRNNs) offer a probabilistic approach but their approximation theory (AT) is complex.
Existing methods struggle with the inherent complexities of time series data within recurrent architectures.

Purpose of the Study:

To investigate the approximation theory (AT) of Bayesian recurrent neural networks (BRNNs) for stochastic time series forecasting (TSF).
To develop a method for analyzing BRNNs' performance on time series data by addressing the incompatibility between data dependencies and network structure.
To establish the convergence properties of the Bayes by Backprop (BBB) training algorithm for BRNNs in the context of TSF.

Main Methods:

Marginalization and transformation of stochastic time series into a probabilistically equivalent latent variable model (LVM).
Analysis of AT by evaluating approximation error between BRNN output mean and LVM output mean using Taylor expansion-based uncertainty propagation and distribution parameterization.
Study of the convergence in probability of the Bayes by Backprop (BBB) algorithm, leveraging Khinchin's law of large numbers.

Main Results:

The approximation error between BRNN and LVM output means was rigorously analyzed.
It was proven that increasing Monte Carlo samples in the Bayes by Backprop (BBB) algorithm enhances convergence probability towards one.
Numerical simulations confirmed the theoretical findings regarding BRNN approximation and BBB convergence.

Conclusions:

The proposed method effectively addresses the challenges of applying BRNNs to stochastic time series forecasting.
The study provides theoretical guarantees for the convergence of the Bayes by Backprop training algorithm.
This work contributes to a deeper understanding of the approximation theory for BRNNs in probabilistic time series modeling.