Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

98
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
98
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models01:06

Model Approaches for Pharmacokinetic Data: Distributed Parameter Models

115
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
115
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

79
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
79
Mechanistic Models: Overview of Compartment Models01:21

Mechanistic Models: Overview of Compartment Models

137
Mechanistic models, a category encompassing both physiological and compartmental modeling, differ from empirical models' approaches to incorporating known factors about the systems being modeled. Empirical models describe data with minimal assumptions, while mechanistic models aim to provide a robust description of available data by specifying assumptions and integrating known factors about the system. Compartmental analysis is a key example of a mechanistic model in pharmacokinetics and...
137
Pharmacokinetic Models: Overview01:20

Pharmacokinetic Models: Overview

961
Pharmacokinetic models utilize mathematical analysis to achieve a detailed quantitative understanding of a drug's life cycle within the body. They are instrumental in simulating a drug's pharmacokinetic parameters, predicting drug concentrations over time, optimizing dosage regimens, linking concentrations with pharmacologic activity, and estimating potential toxicity.
There are three primary types of models: empirical, compartment, and physiological. Empirical models, with minimal...
961
Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model01:13

Parameters Affecting Nonlinear Elimination: Zero-Order Input, First-Order Absorption and Two-Compartment Model

115
Drugs administered through various routes can lead to nonlinear elimination, resulting in complex pharmacokinetic behaviors crucial to understanding efficacious drug dosing.
When a drug is administered through a constant intravenous infusion and eliminated via nonlinear pharmacokinetics, it follows zero-order input. For example, oral drugs undergo first-order absorption upon administration and are eliminated through nonlinear pharmacokinetics.
In the case of subcutaneously administered drugs,...
115

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Tuning tasks to how we learn.

Nature human behaviour·2026
Same author

Latent subdimensions of anxiety and depression differentially influence exertion of effort in pursuit of reward versus avoidance of threat.

Translational psychiatry·2026
Same author

AI-Discovered Cognitive Models Reveal Novel Insights into Human and Animal Learning.

bioRxiv : the preprint server for biology·2026
Same author

Functional reorganization of motor cortex connectivity during learning.

bioRxiv : the preprint server for biology·2026
Same author

Hybrid neural-cognitive models reveal how memory shapes human reward learning.

Nature human behaviour·2026
Same author

A habit and working memory model as an alternative account of human reward-based learning.

Nature human behaviour·2025

Related Experiment Video

Updated: Aug 23, 2025

Author Spotlight: Computing the Effects of a Local Radiofrequency Hyperthermia Intervention on Tumor Biomechanics
10:23

Author Spotlight: Computing the Effects of a Local Radiofrequency Hyperthermia Intervention on Tumor Biomechanics

Published on: December 1, 2023

520

The interpretation of computational model parameters depends on the context.

Maria Katharina Eckstein1, Sarah L Master1,2, Liyu Xia1,3

  • 1Department of Psychology, University of California, Berkeley, Berkeley, United States.

Elife
|November 4, 2022
PubMed
Summary

Reinforcement learning (RL) model parameters often fail to generalize across tasks or capture unique neurocognitive processes. Future research must examine context factors to improve model generalizability and interpretability.

Keywords:
DevelopmentGeneralizabilityInterpretabilitycognitioncomputational biologycomputational modelinghumanneurosciencereinforcement learningsystems biology

More Related Videos

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches
10:50

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches

Published on: June 21, 2022

1.8K
Software for Analysis of Heart Rate and Blood Pressure Time-series Data from the Valsalva Maneuver
14:28

Software for Analysis of Heart Rate and Blood Pressure Time-series Data from the Valsalva Maneuver

Published on: June 27, 2025

349

Related Experiment Videos

Last Updated: Aug 23, 2025

Author Spotlight: Computing the Effects of a Local Radiofrequency Hyperthermia Intervention on Tumor Biomechanics
10:23

Author Spotlight: Computing the Effects of a Local Radiofrequency Hyperthermia Intervention on Tumor Biomechanics

Published on: December 1, 2023

520
Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches
10:50

Computational Modeling of Retinal Neurons for Visual Prosthesis Research - Fundamental Approaches

Published on: June 21, 2022

1.8K
Software for Analysis of Heart Rate and Blood Pressure Time-series Data from the Valsalva Maneuver
14:28

Software for Analysis of Heart Rate and Blood Pressure Time-series Data from the Valsalva Maneuver

Published on: June 27, 2025

349

Area of Science:

  • Cognitive and brain sciences
  • Computational neuroscience
  • Developmental psychology

Background:

  • Reinforcement learning (RL) models are widely used in cognitive and brain sciences to explain behavior and cognition.
  • Contradictory findings in the RL literature raise questions about the validity of current assumptions.
  • Common assumptions include parameter generalizability across contexts and interpretability of neurocognitive processes.

Purpose of the Study:

  • To investigate the generalizability and interpretability of computational model parameters in reinforcement learning.
  • To test whether RL parameters generalize across different learning tasks and capture distinct neurocognitive processes.
  • To examine the developmental trajectories of RL parameters in young individuals.

Main Methods:

  • Recruited 291 participants aged 8-30 years.
  • Administered three distinct learning tasks within a single experimental session.
  • Fitted reinforcement learning models to individual participant data for each task.

Main Results:

  • Some parameters, like exploration/decision noise, showed significant generalization and similar developmental trajectories across tasks.
  • Generalization levels were notably below the methodological maximum, indicating limitations.
  • Other parameters, including learning rates and forgetting, lacked generalization and sometimes exhibited opposing developmental trends.
  • Low interpretability was observed for all tested RL parameters.

Conclusions:

  • The generalizability and interpretability of computational cognitive models are limited by current assumptions about parameters.
  • Contextual factors, such as reward stochasticity and task volatility, significantly influence parameter behavior.
  • Systematic investigation of context factors is crucial for advancing the reliability and explanatory power of RL models in cognitive science.