Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Methods of Medium Optimization01:28

Methods of Medium Optimization

Optimizing growth media enhances microbial proliferation and maximizes product yield. Statistical experimental design methodologies provide structured and reproducible approaches, offering progressively higher levels of robustness and efficiency.The One-Factor-at-a-Time (OFAT) MethodThe One-Factor-at-a-Time (OFAT) method involves adjusting a single variable while keeping all others constant. However, it cannot detect interactions between variables, often leading to suboptimal outcomes when...
Typical Model Studies01:30

Typical Model Studies

Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation01:24

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least squares (OLS)...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Brain Mapping of Behavior Contagion Based on Visibility Graph Analysis of ERP Signals.

Basic and clinical neuroscience·2026
Same author

Behavioral contagion leads the brain functional network towards a more balanced state.

Brain imaging and behavior·2026
Same author

The spatial frequency representation predicts category coding in the inferior temporal cortex.

eLife·2025
Same author

Introducing a New Method for Studying the Effects of Movement Synchrony in Virtual Reality.

Basic and clinical neuroscience·2024
Same author

The effect of an embodied intervention on responsibility: put a load on one's shoulder.

Cognitive processing·2024
Same author

Brain effective connectome based on fMRI and DTI data: Bayesian causal learning and assessment.

PloS one·2023

Related Experiment Video

Updated: Jun 2, 2026

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

Better Than Maximum Likelihood Estimation of Model-based and Model-free Learning Styles.

Sadjad Yazdani1, Abdol-Hossein Vahabie1, Babak Nadjar-Araabi1

  • 1Department of Machine Intelligence and Robotics, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran.

Basic and Clinical Neuroscience
|June 1, 2026
PubMed
Summary
This summary is machine-generated.

This study introduces a novel k-nearest neighbor method to improve reinforcement learning (RL) parameter estimation. The new approach reduces bias and enhances RL

Keywords:
Behavioral observation analysisBehavioral parameter estimationMaximum a posteriori (MAP)Maximum likelihood (ML)Model-based (MB)and model-free (MF) combined learningModeling different styles of learningk-Nearest neighbors

Related Experiment Videos

Last Updated: Jun 2, 2026

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

Area of Science:

  • Computational Neuroscience
  • Cognitive Science
  • Machine Learning

Background:

  • Human decision-making involves goal-directed and habitual systems, often modeled using reinforcement learning (RL) with model-based (MB) and model-free (MF) components.
  • The weighting parameter combining MB and MF action values is typically estimated using maximum likelihood (ML) or maximum a posteriori (MAP) methods.
  • Traditional ML/MAP methods can yield biased and unreliable estimates of this crucial weighting parameter.

Purpose of the Study:

  • To address the limitations of existing methods for estimating the weighting parameter in RL models of human behavior.
  • To propose and evaluate a novel nonparametric estimation method using k-nearest neighbors (kNN).
  • To enhance the reliability and applicability of RL paradigms in understanding human decision-making and clinical research.

Main Methods:

  • RL agents were utilized to perform the Daw two-stage task, simulating combined MB and MF decision-making.
  • A k-nearest neighbor (kNN) approach was developed as an alternative nonparametric estimation method.
  • Twenty behavioral features were extracted from RL agent data to train the kNN model for parameter estimation.

Main Results:

  • The proposed kNN method significantly reduced bias and variance in the estimation of the RL weighting parameter compared to traditional methods.
  • Simulated experiments confirmed the improved accuracy and reliability of the kNN estimation.
  • Analysis of human behavior data demonstrated that the kNN method could predict indices like age, gender, IQ, gaze dwell time, and psychiatric disorder indicators.

Conclusions:

  • The kNN-based estimation method offers a more reliable approach to parameter estimation in RL models.
  • This enhanced reliability improves the potential for applying RL frameworks in clinical settings and understanding individual differences.
  • The method broadens the scope of RL applications by enabling the prediction of a wider range of human behavioral and clinical indices.