Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Modeling and Similitude01:12

Modeling and Similitude

323
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
323
Estimation of the Physical Quantities01:05

Estimation of the Physical Quantities

4.8K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
4.8K
Hindsight Biases01:12

Hindsight Biases

3.5K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
3.5K
What are Estimates?01:06

What are Estimates?

5.3K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates. 
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
5.3K
Decision Making: P-value Method01:09

Decision Making: P-value Method

5.6K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.6K
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

659
This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
659

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Hybrid Event-Triggered Tracking Control With Critic Learning for Nonlinear Networked Systems.

IEEE transactions on cybernetics·2026
Same author

Balancing State Exploration and Skill Diversity in Unsupervised Skill Discovery.

IEEE transactions on cybernetics·2025
Same author

Last-Iterate Convergence to Approximate Nash Equilibria in Multiplayer Imperfect Information Games.

IEEE transactions on neural networks and learning systems·2025
Same author

Meta Learning Task Representation in Multiagent Reinforcement Learning: From Global Inference to Local Inference.

IEEE transactions on neural networks and learning systems·2025
Same author

Discretizing Continuous Action Space With Unimodal Probability Distributions for On-Policy Reinforcement Learning.

IEEE transactions on neural networks and learning systems·2024
Same author

Conditional Goal-Oriented Trajectory Prediction for Interacting Vehicles.

IEEE transactions on neural networks and learning systems·2023
Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026
Same journal

CAFF-CIL: Causality-Aware Freedom Forgetting Approach for Class-Incremental Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Harmonic Autoencoding Framework for Multiple Tasks in Magnetic Particle Imaging Reconstruction.

IEEE transactions on neural networks and learning systems·2026
Same journal

A Survey on Human-Centric Voice-Face Multimodal Learning.

IEEE transactions on neural networks and learning systems·2026
Same journal

Vision-Assisted Foundation Model for Solving Multitask Vehicle Routing Problems.

IEEE transactions on neural networks and learning systems·2026
Same journal

FP3O: Enabling Proximal Policy Optimization in Multiagent Cooperation With Parameter-Sharing Versatility.

IEEE transactions on neural networks and learning systems·2026
See all related articles

Related Experiment Video

Updated: Aug 23, 2025

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
13:04

Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

Published on: September 19, 2012

12.2K

Dynamic-Horizon Model-Based Value Estimation With Latent Imagination.

Junjie Wang, Qichao Zhang, Dongbin Zhao

    IEEE Transactions on Neural Networks and Learning Systems
    |October 31, 2022
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces dynamic-horizon model-based value expansion (DMVE) for adaptive policy learning. DMVE improves sample efficiency and performance in visual control tasks by dynamically selecting optimal rollout horizons.

    More Related Videos

    Constructing and Visualizing Models using Mime-based Machine-learning Framework
    06:19

    Constructing and Visualizing Models using Mime-based Machine-learning Framework

    Published on: July 22, 2025

    276
    Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation
    06:53

    Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

    Published on: March 1, 2017

    13.3K

    Related Experiment Videos

    Last Updated: Aug 23, 2025

    Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods
    13:04

    Measuring the Subjective Value of Risky and Ambiguous Options using Experimental Economics and Functional MRI Methods

    Published on: September 19, 2012

    12.2K
    Constructing and Visualizing Models using Mime-based Machine-learning Framework
    06:19

    Constructing and Visualizing Models using Mime-based Machine-learning Framework

    Published on: July 22, 2025

    276
    Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation
    06:53

    Creating Virtual-hand and Virtual-face Illusions to Investigate Self-representation

    Published on: March 1, 2017

    13.3K

    Area of Science:

    • Reinforcement Learning
    • Computer Vision
    • Robotics

    Background:

    • Model-based value expansion (MVE) methods use world models for policy learning.
    • Fixed rollout horizons in MVE can be suboptimal and time-consuming to tune, especially for visual tasks.

    Purpose of the Study:

    • To develop a novel method for adaptive value expansion using world models.
    • To address the limitations of fixed horizons in MVE for policy learning.

    Main Methods:

    • Proposes dynamic-horizon MVE (DMVE) with adaptive rollout horizon selection.
    • Utilizes reconstruction-based techniques and latent imagination for multi-horizon rollouts.
    • Employs a horizon reliability detection approach for accurate value estimation.

    Main Results:

    • DMVE outperforms existing baselines in sample efficiency and final performance on visual control tasks.
    • Demonstrates scalability and effectiveness on an autonomous driving lane-changing task.

    Conclusions:

    • DMVE offers a more effective approach to value expansion in model-based reinforcement learning.
    • Adaptive horizon selection enhances policy learning in complex visual environments.