Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...

Outliers and Influential Points

Outliers and Influential Points

An outlier is an observation of data that does not fit the rest of the data. It is sometimes called an extreme value. When you graph an outlier, it will appear not to fit the pattern of the graph. Some outliers are due to mistakes (for example, writing down 50 instead of 500), while others may indicate that something unusual is happening. Outliers are present far from the least squares line in the vertical direction. They have large "errors," where the "error" or residual is the...

Random Error

Random Error

Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...

Naturalistic Observations

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Trash to treasure: converting plastic waste into a useful graphene foil.

Nanoscale·2017

Same author

Identification of 8 Novel Mutations in Nephrogenesis-Related Genes in Chinese Han Patients with Unilateral Renal Agenesis.

American journal of nephrology·2017

Same author

Real-Time Imaging of Endocytosis and Intracellular Trafficking of Semiconducting Polymer Dots.

ACS applied materials & interfaces·2017

Same author

Associations between <i>Interleukin-31</i> Gene Polymorphisms and Dilated Cardiomyopathy in a Chinese Population.

Disease markers·2017

Same author

Real-time visualization of clustering and intracellular transport of gold nanoparticles by correlative imaging.

Nature communications·2017

Same author

Successful treatment of refractory cancer pain with morphine and ropivacaine: A case report.

Medicine·2017

Search research articles

Related Experiment Video

Updated: Nov 27, 2025

Design and Analysis for Fall Detection System Simplification

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

Can Short and Partial Observations Reduce Model Error and Facilitate Machine Learning Prediction?

¹Department of Mathematics, University of Wisconsin-Madison, 480 Lincoln Dr. Madison, Madison, WI 53706, USA.

Entropy (Basel, Switzerland)

|December 8, 2020

Summary

This study introduces a new algorithm for predicting complex turbulent systems despite model errors and limited data. The method enhances machine learning forecasts by generating diverse training data from imperfect models.

Keywords:

conditional sampling data assimilation machine learning model error non-Gaussian systems short and partial observations

Related Experiment Videos

Last Updated: Nov 27, 2025

Design and Analysis for Fall Detection System Simplification

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

Area of Science:

Dynamical systems theory
Computational fluid dynamics
Machine learning applications in environmental science

Background:

Predicting complex nonlinear turbulent dynamical systems is crucial but challenged by model errors and sparse observations.
Machine learning (ML) shows promise but is hindered by data limitations in real-world scenarios.
Existing methods struggle to reconcile imperfect models with incomplete observational data.

Purpose of the Study:

To develop an efficient and dynamically consistent conditional sampling algorithm for generating reliable training data.
To improve the performance of machine learning forecasts for turbulent dynamical systems using imperfect models.
To address the challenge of data scarcity and model error in predicting complex natural phenomena.

Main Methods:

Developed a novel conditional sampling algorithm integrating path-wise temporal dependence within a forward-backward data assimilation framework.
Employed a two-step procedure to sample multiple distinct nonlinear time series from imperfect models using partial observations.
Utilized a computationally efficient stochastic differential equation for sampling in nonlinear and non-Gaussian systems.

Main Results:

The conditional sampling algorithm successfully reduced model error and enriched training datasets for machine learning.
Generated massive training data for multiscale compressible shallow water flows from indirect and nonlinear observations.
Machine learning forecasts significantly outperformed traditional imperfect model predictions, demonstrating enhanced accuracy.

Conclusions:

The developed algorithm provides an efficient and accurate method for generating high-quality training data for ML in complex systems.
This approach effectively mitigates model error and data limitations, leading to superior predictive performance.
The method shows promise for forecasting challenging phenomena like non-Gaussian climate patterns with minimal observational data.